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FOREWORD 


The  fast-changing  state  of  lh«  electronics  art,  together  with  increasingly  com- 
ptHS  equipments  demanding  high  reliability,  has  created  the  noeu  for  (1.)  additional 
requirements  in  electronic  parts  and  tubes  specifications,  03)  faster  coordination  of 
parts  specifications,  (3)  the  eatabliahment  of  technical  characteristics  data  for  dis¬ 
semination  to  design  and  logistics  personnel  and  (4)  a  complete  review  of  the  parts 
specifications  program  to  ensure  compatibility  with  tha  reliability  program.  Thesa 
basic  needs  were  recognized  and  reported  by  Tank  Group  5  of  the  Advisory  Group  on 
Reliability  of  Electronic  Equipment  in  ita  report  dated  4  Juno  1657. 

Accordingly,  tha  Ad  Hoc  Study  Group  on  Parts  Specifications  Management  tor 
Reliability  was  established  by  a  memorandum  of  agreement  dated  14  July  1080  under 
the  Joint  sponsorship  of  the  Office  of  the  Assistant  Secretary  of  Defense  (Research 
and  Engineering)  and  the  Office  of  the  Assistant  Secretary  of  Defense  (Supply  and 
Logistics).  The  basic  objective  of  the  study  was  to  analyze  the  recommendations  of 
tha  AGREE  Task  Group  8  and  advise  the  sponsors  regarding  efficient  implementation, 
methods  and  procedures. 

This  report,  which  contains  the  findings  and  recommendations  of  the  Study 
Group,  is  issued  at  this  timb  for  informational  purposes  only. 

la  view  of  the  study's  wide  scope,  the  Group's  recommendations  will  exert  a 
major  Impact  on  many  groups  in  both  government  and  industry  and  at  levels  from 
management  down  to  the  many  technical  and  service  activities.  Many  of  the  proce¬ 
dures  recommended  radically  depart  from  methods  now  used;  however,  only  through 
these  new  techniques  can  we  gain  the  achievable  benefits  that  are  needed  to  meet 
present  design  demands.  v. 

..  ....  •'  .  •  .. .  ■  :/■'  'v  :'i'-  v*. ....  .  ‘ ;  .  ' 

Moreover,  this  report  indicates  that  the  time  schedule  Is  critical  and  that 
maximum  benefits  will  be  obtained  only  if  the  recommendations  are  carried  out 
Immediately.  Again,  this  poses  a  challenge  to  all  the  Interested  governmental  and 
Industrial  activities.  •  v . 

•  The  prototype  specifications  and  standard  format  for  design  and  documentation 
are  offered,  not  as  the  ultimate,  but  m  guides  to  a  methodology.  In  our  rapidly 
advancing  technology,  new  and  better  developments  may  be  expected  by  the  time  tha 
total  program  outlined  In  this  report  can  be  implemented. 

Accordingly,  all  recipients  of  this  report  are  urged  to  use  any  of  this  material 
that,  may  be  useful  and  appropriate  to  their  aotivitiea. 


Director  for  Supply  Mfafgcment  Policy 
Office  of  the  Assistant  Secretary  of 
Defense  (Supply  and  Logiatlos) 


Director  of  Bleotronlca 
OCRoe  of  the  Director  o{  Defense 
Research  and  Engineering 
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MEMORANDUM  FOR  Mr.  J.  M.  Bridges,  Director  of  Sloe  ironies,  ODDR&E 

Mr.  P.  H.  Riley,  Director  for  Supply  Management  Policy, 
OAflD(S4*L) 

SUBJECT*.  Report  of  the  Ad  Hoc  Study  Group  on  Electronic  Parts  Specifications 
Management  for  Reliability 

The  Ad  Hoc  Study  Group  on  Electronic  Parts  Specifications  Management  for 
Reliability  baa  conducted  its  study  In  accordance  with,  your  memorandum  of  agree¬ 
ment  dated  14  July  1968  and  the  related  task  assignment..  The  final  report  of  this 
study  ia  herewith  respectfully  submitted  for  your  transmittal  to  the  Director  of 
Defense  Research  and  Engineering  and  the  Assistant  Secretary  of  Defense  (Supply 
and  Logistics)^;.  , 

As  you  know,  the  scope  of  this  study  Is  very  broad;  the  recommendations  and 
implementing  actions  will  exert  a  major  impact  on  many  of  our  current  operations  in 
both  government  and  industry.  Though  the  study's  objectives  were  to  attain  radical 
Improvements  in  order  to  cope  with  demanding  systems  requirements  and  the  fast¬ 
growing  state  of  the  art,  the  recommended  plans  and  procedures  attempt  to  bring 
about  these  radical  improvements  In  an  evolutionary  manner. 

The  recommendation*  are  rather  specific,  detailing  an  organizational  struc¬ 
ture  and  establishing  three  prototype  specifications  as  well  as  new  procedures  for 
refining  tho  technical  documentation  of  parts  characteristics.  However,  this  is 
simply  the  framework  of  the  total  program.  The  Group  feels  strongly  that,  unless 
the  recommendations  are  Immediately  put  into  effect,  many  of  the  achievable  gains 
and  benefits  will  not  be  realized. 

The  chairman  wishes  to  acknowledge  his  indebtedness  to  all  those  who  co 

to  the  study  and  to  thank  them  for  their 


Chairman,  Ad  Hoc  Study  Group  on 
Electronic  Parti  Specifications 
Management  for  Reliability 


Paul  S.  Darnell' 


diligently  applied  their  time  and  efforts 
valuable  support  and  cooperation. 
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Memorandum  of  Agreement. 


On  14  7ul)  1968,  a  memorandum  (Appendix  I)  was  signed  bv  the  Director  for 
Production  Policy,  Office  of  the  Assistant  Secretary  of  Defense  (Supply  and  Logis¬ 
tics),  and  the  Director  of  Electronics,  Office  of  the  Assistant  Secretary  of  Defense 
(Research  and  Engineering),  *  In  which  they  agreed  on  the  need  for 


...  (a)  additional  requirements  In  electronic  parts  and  tabes  specifi¬ 
cations,  (b)  more  rapid  coordination  of  specifications,  (c)  establish¬ 
ment  of  technical  characteristics  data  for  dissemination  to  design 
and  logistics  personnel  and  (d)  &  complete  review  of  the  parts  spec¬ 
ifications  program  to  insure  compatibility  with  the  reliability  program. 


They  further  agreed  that  Ktha  solution  to  these  problems  should  be  undertaken 
In  the  manner  delineated  in  Enclosure  (1),*  which  was  "Task  Assignment  for  an  Ad 
Hoc  Study  on  Parts  Specification  Management  for  Reliability.  *  The  task  assignment 
outlined  the  study's  sponsorship  aid  die  conditions  cf  administrative  support  and 
specified  the  membership  at  the  study  group.  The  problem  to  be  evaluated  by  the 
study  was  stated  as  follows: 


Increasingly  more  complex  electronic  equipments  demanding  high 
reliability  have  created  the  need  for  additional  requirements  in  the 
parts  and  tabes  specifications.  The  specifying  of  reliability  In  quan¬ 
titative  terms  requires  the  Introduction  cf  reliability  requirements 
into  both  equipment  and  component  specifications  as  well  as  the  de¬ 
velopment  of  practical  and  economical  test  procedures  to  verify  com¬ 
pliance  with  the  specifications.  In  addition,  quality  control  procedures 
should  include  features  to  Insure  maintenance  ctf  reliability  levels 
throughout  production  run*. 

To  enable  designers  to  develop  equipments  which  will  meet  quantita¬ 
tive  specification  of  reliability  for  equipments  and  systems  it  is 
essential  that  design  guidance  and  application  data  such  as  component 
failure  rates  as  a  function  of  time  and.  environment  be  made  available 
to  engineering  groups.  H5are  1s  a  great  need  to  obtain  and  dissemi¬ 
nate  these  technical  characteristics  of  components  a*  quickly  as 
possible. 

la  the  Interests  of  economy,  procedures  must  bo  designed  and  devel¬ 
oped  which  will  avoid  duplication  of  acceptance  tests. 


■Now  the  Office  of  the  Director  of  Defense  Research  and  Engineering. 


The  basic  objective  of  the  study  iris  "to  analyte  the  recommendation*  established 
by  the  AGREE  Task  Group  6  In  order  to  advise  the  Assistant  Secretaries  of  Defense 
(R&E)  and  (SAL)  regarding  efficient  Implementation  methods  and  procedures.^  The 
following  w»r*  included: 

(a)  Recommend  criteria  and  methods  for  specifying  the  reliability 
of  parts  and  tubes  in  terms  of  failure  rats  as  a  function  of  time, 
environment  and  circuit  appl'c&tion  severity. 

Co)  Survey  the  methods  used  In  preparation  of  parts  and  tubes  speci¬ 
fications  as  well  as  coordination  procedures  and  practices.  This 
survey  shall  bo  mada  to  suggest  changes  which  would  accommodate 
the  specification  of  reliability  level  and  Its  allied  reliability  assur¬ 
ance  requirements.  Procedures  proposed  shall  be  to  enhance  rapid 
and  full  specification  coordination  within  the  Military  Departments 
cud  with  Industry. 

(c)  Review  of  Qualified  Products  List  (QPL)  and  Qualification  Test¬ 
ing  Procedures  to  evaluate:  (1)  If  qualification  is  being  properly 

,  Implemented.  (2)  Adequacy  of  tests  with  respect  to  the  reliability 

(  requirements  and  quality  control  procedures  Included  In  the  specl- 

j  flcatlon.  (3)  Provisions  for  avoiding  any  duplication  of  Qualification 

|  Testing  by  various  contractors. 

(d)  Recommend  reliability  assurance  test  procedures  to  verify  com¬ 
pliance  with  the  reliability  level  specified. 

(e)  Recommend  a  program  and  methodology  for  obtaining  technical 
characteristics  and  test  data  of  parts  Including  failure  rate  data  and 
the  procedure  for  making  this  data  available  to  designers  and 
logistics  personnel. 

(f )  Investigate  the  need  for  a  document  other  than  the  specification 
to  provide  design  guide  information  such  as  parts  and  tube  applica¬ 
tion  curves  (Including  falluro  rate  curves  or  data  as  &  function  of 
circuit  application  severity  level  and  environment).  Such  a  docu¬ 
ment  would  provide  design  guide  Information  as  opposed  to  the  firm 
specification  requirement  data  mentioned  above. 

Finally,  the  task  assignment  called  for  a  report  of  the  conclusions  resulting 
from  the  study  for  consideration  by  the  sponsoring  Assistant  Secretaries  of  Defense. 

1. 3  Subtask  Assignments. 

The  main  task  assignment  was  broken  down  into  subtasks  to  ensure  a  thorough 
coverage  of  the  many  problem  areas.  The  subtasks  are  as  follows: 

1.  Incorporation  of  reliability  requirements  In  specifications,  in¬ 
cluding  test  requirements  to  assure  reliability  levels  defined. 

2*Tba  Findings  and  Recommendations  of  Task  Group  No.  6,"  Reliability  of 
Military  Eleotrordo  Equipment,  Report  by  Advisory  Oroup  on  Reliability  of  Elec¬ 
tronic  Equipment,  Office  of  the  Assistant  Secretary  of  Defense  (Research  and 
Engineering),  4  June  1967,  Unclassified. 


2 


2.  Specification  requirements  and  test  methods  or  programs  other 
than  those  specifically  directed  to  reliability  considerations,  needed 
to  form  the  basis  of  qualified  product  lists,  acceptance  testing,  etc. 

3.  Methods  and  procedures  for  the  adequate  collection  and  dissemi¬ 
nation  of  technical  information  on  both  parts  in  use  arul  new  items. 

4.  Specification  writing  and  coordinate  procedures,  to  achieve  uni¬ 
fication  and  to  insure  specifications  constant  with  the  full  capabili¬ 
ties  of  the  parts. 

|(ji  :  •  :il 

6.  Procurement  and  engineering  practices  of  contractors,  supply 
groups  and  other  agencies  to  insure  use  of  qualified,  reliable  parts. 

It  was  realized  that,  regardless  of  how  the  division  of  subtasks  was  made, 
mutually  exclusive  working  groups  could  never  be  established  and  that  accordingly 
there  would  be  a  need  for  close  coordination  among  the  subgroups'  efforts.  This 
w ns  achieved  through  close  cooperation  by  the  subgroup  chairmen  and  by  assigning 
each  member  of  the  parent  study  group  to  at  least  two  subgroups.  (The  member¬ 
ship  of  the  study  group  and  the  subgroups  is  listed  in  Appendix  n. ) 

U'i-  i ' 
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1,  RECOMMENDATIONS 


2.1  Electronic  Parts  Specifications  Management. 

(1)  An  Advisory  Group  on  Management  of  Electronic  Parts  Specifications 
(AGMEPS)  should  be  established  as  an  activity  of  the  Office  of  the  Assistant  Secre¬ 
tary  of  Defense  (Supply  and  Logistics)  (OASD-S&L),  roportlng  directly  to  that 
Assistant  Secretary.  The  members  of  the  Group  should  be  appointed  by  him,  and 
their  selection  should  be  coordinated  with  the  Director  of  Defense  Research  and 
Engineering  (DDR&E).  The  members  should  be  drawn  from  representatives  of 
the  OASD  (S&L),  the  ODDR&E  and  the  Military  Departments  and  consultants  of  the 
Office  of  the  Secretary  of  Defense  (OSD)  «ho  are  expert  In  the  indicated  fields  of 
Interest 


(a)  Administrative  control  of  the  Advisory  Group  should  be  delegated  to 
the  OASD  (S&L)  office  that  has  been  assigned  the  responsibility  for  standardization. 

(b)  The  members  selected  for  the  Advisory  Group  should  represent  a 
balanced  team,  with  management  and  technical  experience  In  the  areas  of  electronic 
parts,  tubes  and  semiconductors;  the  electronic -systems  design  area;  and  the 
engineering,  procurement  and  logistics  areas  of  the  Department  of  Defense  (DOD). 

(c)  The  chairman  of  the  Advisory  Group  should  be  an  OSD  consultant, 
rather  than  a  representative  of  the  OASD  (S&L),  the  ODDR&E  or  the  Military  De¬ 
partments,  so  as  to  gain  a  greater  objectivity  In  directing  the  Advisory  Group's 
activities. 

(d)  The  Advisory  Group  should  maintain  liaison  with  the  Advisory  Group 
on  Electronic  Parts,,  the  Advisory  Group  on  Electron  Tubes  and  other  OSD  advisory 
groups  that  have  programs  relating  to  the  parts  specifications  programs. 

(•)  The  Advisory  Group  should  review  all  proposed  DOD  proarams  re¬ 
lating  to  electronic -parts  specification  development  and  technical  documentation  and 
the  management  thereof  and  should  assist  the  ASD  (S&L)  by  submitting  recommen¬ 
dations  regarding:  L  the  most  sfflclent  Implementing  actions,  2.  the  most  effective 
program  and  9.  changes  to  any  proposed  programs  that  will  ensure  the  Implementa¬ 
tion  of  this  report's  detailed  recommendations.  (Appendix  HI  is  a  proposed  DOD 
instruction  establishing  an  Advisory  Group  on  Management  of  Electronic  Parts 
Specifications  as  recommended  herein. ) 

(2)  The  Armed  Service#  Electro-Standards  Agency  (ASESA)  should  be  organ¬ 
isationally  relocated  In  the  OASD  (S&L),  reporting  to  the  S&L  office  that  is  recpon- . 
slble  tor  standardisation.  In  this  position,  ASESA  should  provide  administrative 
support  to  the  program  of  electronics-parts  specifications  management  and  secre¬ 
tarial  support  to  the  AGMSPS.  Thus,  by  providing  a  single  point  of  responsibility 
at  an  OSD  level,  ASSSA's  production  capacity  will  be  more  directly  used  and  Its 
efficiency  improved, 
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.«,.K,L3LJl,9r3^lb’lltr.for  parla  3Poc^lcat1on3  management  as  presently 
established  In  the  OSD  should  ho  rodoflncd,  If  necessary,  no  that  tho  following 

functions  may  bo  carrlod  on  expeditiously  and  efficiently  by  tho  office  responsible 
for  standardization,  lr»  accordance  w*th  the  detailed  recomtneivtatinrvj.  ^jg 

(a)  Prepare  and  recommend  DOD  policy  and  program -implementation 
plans  concerning  the  development  of  specifications,  3tandard3  and  handbooks  for 
electronic  parts  and  tubes. 

b  Recommend  priorities  and  schedules  for  the  specification-de¬ 
velopment  program  that  will  be  consistent  with  the  operational  needs  of  the  Military 
Departments.  3 

2.  Review  all  specification  programs  and  actions  to  ensure  their 
adherence  to  established  schedules. 

3.  Recommend  techniques  and  guidelines,  to  be  used  in  preparing 
military  specifications,  that  will  ensure  the  completeness  and  adequacy  of  spec  111- 
C*i«0^f-i«f2r.pro.clir.emer1^  should  Include  the  specification  of  performance  and 
reliability  In  standard  levels;  test  plans  necessary  to  prove  compliance  with 
specification  requirements;  procedures  for  qualification  approval;  and  the  develop¬ 
ment  and  dissemination  of  parts  application  data,  including  failure  rate  as  a  func¬ 
tion  of  time  and  levels  of  application  severity. 

^  Ensure  that  parts  characteristics  data,  including  test  data,  are 

collected,  analyzed  and  used  In  the  development  of  new  specifications  or  the  revi¬ 
sion  of  existing  ones. 

.  M  Coordinate  the  programs  on  specifications  development  and  technical 

documentation  with  the  many  other  programs  of  the  Military  Departments,  such  as 

f5rt“Ttad  ™»«R«search and  Development  Program  and  the  In¬ 
dustrial  Mobilization  Planning  Program.  Coordination  should  be  extended  to  ensure 
the  pxigrams  compatibility  with  industrial  facilities  and  activities  in  the  areas  of 
parts  ana  tubes. 

^ciflcuSi,  <or  “d  coordtaa"»  “«»»» <=» 

„ _ .  ,  b  Approval  of  a  specification  for  purposes  of  trl -Service  coordlna- 

b.  OMd upon .  m.jorit,  v=u  of  th.  ,roup 

, .  -•  A  specification  development  or  coordination  action  mav  be  iniH 

*tad  by  any  on.  of  th.  following  by  request  to  the 

Departments  "  0A3D  <3&L)  ***  ODDRAE  groups  or  any  one  of  the  Military 

b.  The  FSC  (Federal  Supply  Classification)  assignee 
o.  A  member  of  the  Advisory  Group 

mail*  x_  ,  —  Recognized  Industry  standardization  groups.  This  will  nor- 

Sffi?  draft  »P^Wcation  submitted  to  any  one  of  the 

Military  Departments,  to  ths  Advisory  Group,  to  the  OASD  (SAL)  or  to  the  0DDR4E. 
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should  be  reviewed  by  tho  Advisory  Group  for  arprovol 
•'-'ill  g.'-elfloailon  program. 


mi  <1  *rtc- 


iro-i~  confl'.-:*  In  tho  ovor-al' 
loms  arising  In  tho  development  of  parte  specifications.' 
Advisory  Group  should  be  employed  for  this  purpose. 


C  j.  « 1  uiti’Vi 

V/henover  possible,  the 


Develop  criteria  for  the  generation  of  oreferred  parts  ll3ts  to  be  con¬ 
tained  In  military  standards  and  approved  sources  of  supply  for  qualified  electronic 
parts  llst3  to  be  Included  In  military  specifications  or  procurement  documents, 
where  applicable. 


1.  Ensure  that  preferred  parts  lists  are  developed  and  promptly 

issued. 

2.  Ensure  that  application  data,  Including  failure  rates,  are  deve'  - 

oped  and  promulgated. 

3.  Ensure  that  a  Parte'  Qualification  Activity  Is  established. 

4.  Ensure  that  approved  sources  of  supply  for  qualified  electronic 

parts  lists  are  developed  and  promptly  Issued. 

(f )  Ensure  that  the  financial  management  of  the  program  is  consistent 
with  the  foregoing  recommendations  on  programing,  implementation  and  coordination. 

1.  Recommend  funding  levels 

1*  Monitor  manpower  levels  and  other  expenditures. 

(4)  Appendix  HI  is  a  proposed  DOD  instruction  establishing  an  Artvtsorv 
Group  on  Management  of  Electronic  Parte  Specifications,  as  recommended  herein. 

2.2  Specifications  for  Reliable  Parts. 

(1)  The  OSD  and  the  Military  Departments  should  issue  the  necessary  direc¬ 
tives  to  implement  the  recommended  program,  based  on  the  concepts  for  establish¬ 
ing  parts  failure-rate  levels  contained  In  the  report  of  Subgroup  ST-1,  and  to  bring 
all  military  electronic -parts  specifications  up  to  current  design  demand. 

(2)  The  prototype  specifications  and  the  description  of  the  basic  concepts  and 
objectives  and  explanatory  material  contained  In  Volume  H  should  be  forwarded  to 
activities  that  prepare  military  specifications  for  guidance  In  the  formulation  of  new 
and  revised  parts  specifications. 

(3)  The  prototype  specifications  ar.d  explanatory  material  In  Volume  n  should 
al30  be  forwarded  to  Industrial  associations  for  Information  and  guidance. 

(4)  The  concepts  outlined  In  section  1  of  Volume  n  should  be  applied  to  all 
military  specifications  for  electronic  parts. 

(5)  In  tho  promulgation  of  directives  and  Instructions,  the  Importance  of  the 
time  element  and  the  need  for  achieving  coordination,  without  necessarily  having 
full  agreement  on  all  detallod  procedures  and  requirements,  should  be  emphasized. 
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2.  3  Procedure  for  Qualification  Approval. 

(1)  The  procedure  for  qualification  approval  of  electronic  parts  and  tubes 
should  be  revised  to  establish  qualification  for  a  specific  reliability  level  that  will 
be  monitored  during  production. 

(2)  Prior  to  the  submission  of  samples  for  qualification  approval,  the  manu¬ 
facturer  should  show  evidence  that  he  has  the  test  equipment  he  needs  to  conduct 
all  tests  required.  In  the  specification  and  that  he  has  satisfactory  in-plant  process 
control. 


(3)  Qualification  approval  should  be  given  only  on  submission  of  sufficient 
data  representative  of  production  quality;  furthermore,  the  manufacturer  should 
conduct  all  qualification  tests  under  the  surveillance  of  the  appropriate  government 
Inspection  service. 

(4)  Qualification  approval  should  be  re-evaluated  periodically  by  test-data 
audit;  it  may  also  be  re-evaluated  as  a  result  of  changes  in  the  product  design  or 
manufacturing  process  or  when  the  specification  requirements  have  been  altered. 

(5)  Department  of  Defense  Manual  M204,  Military  Qualified  Products  List, 
should  be  revised  as  required  to  establish  and  promulgate  a  list  of  approved  sources 
of  supply  for  qualified  electronic  parts. 

(0)  The  recommended  procedure  for  qualification  approval  should  be  applied 
to  all  specifications  for  electronic  parts. 

(7)  Approved  sources  of  supply  lists  for  qualified  electronic  parts  should  be 
made  readily  available  to  both  parts  users  and  parts  manufacturers. 

2.4  Acceptance  Inspection. 

(1)  Parts  manufacturers  should  be  responsible  for  all  acceptance  Inspection 
called  for  by  a  specification  (see  Volume  II,  section  3). 

(2)  Equipment  manufacturers  should  require  parts  manufacturers  to  conduct 
acceptance  Inspection  and  to  supply  certified  test  data  with  each  shipment  as  objec¬ 
tive  evidence  of  the  parts'  conformance  to  military  specifications. 

(3)  Each  part  should  be  marked,  or  suitably  Identified,  to  Indicate  that  the 
parts  manufacturer  has  qualification  approval  and  that  the  part  meet3  the  require¬ 
ments  of  the  specification. 

(4)  The  Department  of  Dofenso  should  act  early  to  standardize  an  appropriate 
method  for  handling  the  "consumer's  risk"  problem  In  military  specifications  for 
electronic  parts  rolatlvo  to  tosts  other  than  thoso  for  falluro-rato  Inspection. 

(5)  Another  program  should  be  Initiated  for  establishing  reliability  .sauranco 
in  military  specifications  for  small  lots  of  expensive  Items. 
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program. 

2.  D  D.-olqn  in*!  Prccurom'.T.t  Documentation. 


(1)  A  project  3hould  be  established  immediately  In  the  Department  of  Defense 
to  prepare  and  issue  a  policy  manual,  using  as  a  gui'io  the  information  contained  in 
Volume  II,  section  3.  The  manual  should  also  contain  information  now  found  In 
Manuals  M201,  M202,  M203,  M204,  M205  and  M2C0,  suitable  revised  to  remove 
present  contradictions. 

(2)  An  item-numbering  procedure  should  be  established  to  provide  a  means 
of  identifying  basic  parts,  taking  into  account  all  the  ramifications  of  this  problem, 
including  the  factors  that  warrant  changing— or  not  changing— the  basic  identifica¬ 
tion  a3  the  result  of  the  revision  of  technical  requirements. 

2.0  Contractual  Data  Requirements. 


(1)  For  those  Items  not  completely  described  by  military  specifications,  mil¬ 
itary  contractors  and  subcontractors  should  be  required  contractually  to  submit 
copies  of  their  electronic-parts  procurement  documents  (drawings  or  specifications) 
to  a  central  organization  In  the  Department  of  Defense,  along  with  test  data  sub¬ 
stantiating  the  conformance  of  these  parts  to  3uch  documentation. 

(2)  Military  contractors  and  subcontractors  should  be  required  contractually 
to  submit  copies  of  their  company  standards  for  electronic  parts  in  the  format  de¬ 
scribed  In  Volume  n,  section  3,  to  a  central  organization  In  the  Department  of 
Defense,  along  with  test  data  substantiating  the  conformance  of  these  parts  to  such 
documentation. 

(3)  Military  contractors  and  subcontractors  should  be  required  contractually 
to  use  the  test  methods  of  MIL-5TD-202  in  their  electronic-part3  procurement 
documents. 

2.7  Military  Inspection  Practices. 


(1)  The  prime  responsibility  for  acceptance  or  rejection  of  electronic  parts 
under  an  equipment  contract  should  remain  with  the  equipment  manufacturer, 

(2)  Full  support  should  be  given  to  a  well -organized  training  program  for 
government  Inspectors  in  which  inspectors  would  receive  technical  and  statistical 
training  commensurate  with  proper  understanding  of  the  device  that  they  are  inspect¬ 
ing  and  the  sampling  plans  being  used. 

(3)  Government  Inspectors  should  be  encouraged  to  assist  parts  suppliers  in 
obtaining  expeditious  resolution  of  problems  relating  to  the  interpretation  of  speci¬ 
fications.  Inspectors  and  part3  manufacturers  should  report  problems  of  specifica¬ 
tion  interpretation  to  the  agoncy  that  preparod  tho  specification.  This  foodback  will 
Initiate  tho  appropriate  changes  In  tho  specifications. 

(4)  Tho  government  inspection  service  should  verify  the  accomplishment  of 
in-plant  quallflcutlon-upproval  tost3. 
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(2)  Approval  of  the  preparation  and  Issuance  of  limited-coordination 
military  specifications  should  bo  made  the  responsibility  of  an  office  at  the  OSD 
level  Instead  of  the  Individual  Military  Department. 

(3)  Approval  of  the  preparation  and  Issuance  of  limited-coordination 
military  specifications  should  be  based  upon  a  satisfactory  justification  prepared 
by  the  Military  Department  concerned. 

(4)  A  suitable  record  of  activities  relating  to  electronic-parts  specifications 
throughout  the  Military  Departments  should  be  maintained  by  an  office  at  the  OSD 
level,  for  reference  purposes  and  to  prevent  duplicating  activities  in  thl3  field. 

(5)  Existing  definitions,  regulations  and,  perhaps,  the  name  "limited  coordi¬ 
nation  military  specifications"  should  be  revised  to  ensure  that  they  will  be  binding 
upon  all  other  Military  Departments  immediately  upon  issuance,  except  that  a  period 
of  60  days  will  be  allowed  any  Department  to  show  why  the  specification  is  not  satis¬ 
factory  for  its  use. 

2.9  Procurement  and  Engineering  Practices. 

(1)  Effective  administrative  control  should  be  established  to  ensure  that  prime 
contractors  make  maximum  use  of  an  abbreviated  listing  of  standard  reliable  parte 
it  equipment  design. 

(2)  The  styles  and  types  of  standard  reliable  parts  should  be  restricted  to  a 
considerably  greater  degree  than  te  currently  true  of  military  standards  in  order 
to  minimize  the  test  load  inherent  in  establishing  failure  rates. 

(3)  Consolidated  procurement  of  standard  reliable  parte  should  be  established 
for  replacement  purposes. 

(4)  A  study  of  the  details  of  stock  binning  down  through  all  levels  of  the  supply 
system  from  stock  control  point  to  field  repair  activities  should  be  Instituted, 
directed  specifically  toward  ensuring  appropriate  first-in/fiist-out  stock  control 
and  the  maintenance  of  Information  on  Identity  and  age  of  parts. 

(5)  The  standardization  manuals  should  be  modified  to  include  those  procure¬ 
ment  policies  that  are  of  concern  to  specification  writers  and  essential  to  tho 
adequate  preparation  of  specifications. 
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fi)  the  r-.-'o  of  -porto-  l  failureu  to  toed  fallur;s; 

fb)  provide  for  bettor  analytical  recognition  of  primary  failures; 

(c)  provide  for  analytical  criteria  of  misapplications;  and 

(d)  make  mandatory  the  recording  of  olapsed-tlme  readings  and  the  In¬ 
clusion  In  these  readings  of  operating  time  for  unit3  not  failing. 

(2)  The  Military  Departments  should  establish  as  standard  that  military  equip¬ 
ment  Incorporate  elapsed-time  Indicators  where  feasible. 

(3)  The  Military  Departments  should  standardise  one  elapsed-time  Indicator 
for  use  in  electronic  equipment. 

(4)  A  bibliography  of  reports  should  be  prepared  and  maintained  in  a  state  of 
constant  revision  to  provide  "visibility"  of  Investigative  efforts  on  electronic  parts  on 
a  current  basis,  whether  military  or  nonmilitary. 

(5)  A  comprehensive  program  to  evaluate  electronic  parts  should  be  estab¬ 
lished  to  obtain  failure-rate  data  as  a  function  of  circuit  and  environmental  stress. 

2.11  Exchange  of  Technical  Data. 

(1)  A  central  organization  should  be  set  up  for  the  collection  and  dissemination 
of  technical  Information  on  electronic  parts  defined  by  military  specifications. 


10 


3.  BACKGROUND  AND  DI3CUS3IGN  OF  RECOMMENDATIONS 


3. 1  Parts  Specification  Management. 

When  ore  reviews  the  problems  stemming  from  the  Military  Services’  failure 
to  prepare  adequate  specifications --or  from  the  preparation  of  Inadequate  specifi¬ 
cations— and  the  background  of  the  problems,  one  Inevitably  coccluses  that  they 
stem  primarily  from  unsuitable  and  inadequate  specification  organisation  and 
management  on  the  part  of  the  Department  of  Defense  and  the  Military  Services  and 
only  secondarily  from  technical  Inadequacies. 

A  review  of  this  nature  emphasizes  the  unfortunate  fact  that,  because  of 
budgetary,  personnel  or  other  Departmental  programs,  the  Military  Services  have 
considered  parts  specification  and  standardization  programs  only  as  part-time 
efforts  and  have  cot  given  them  the  status,  attention  and  resources  that  they  deserve 
in  view  of  the  tremendous  dollar  savings  and  greater  equipment  reliability  they 
could  make  possible.  Effective  specification  organization  and  management  would 
have  assured  to  such  programs  the  attention  warranted  by  these  potential  advantages. 
It  is  true  that,  even  if  there  were  such  a  specification  organization  and  management, 
we  would  still  be  concerned  with  problems  of  reliability  and  cost,  but  they  would  be 
of  a  far  less  critical  magnitude  than  they  are  today. 

If,  for  example,  we  review  the  procedure  for  specification  coordination,  to 
Justify  the  inordinately  long  time  of  up  to  16  months  that  is  occasionally  required, 
we  find  a  specification  organization  and  management  that  is  totally  unable  to  cope 
with  the  simple  problem  that  arises  when  an  individual  in  one  of  the  Military  Ser¬ 
vices  will  not  agree  to  some  particular  wording  In  a  specification  suggested  by 
someone  in  another  Military  Service.  Because  he  will  not  agree  and  because  there 
is  no  suitable  procedure  for  reconciliation,  coordination  cannot  be  completed  and 
the  disapproving  Military  Service  Is  accused  of  noncooperation. 

Rupposedly,  there  Is  an  assignment  of  responsibility  in  specification  organiza¬ 
tion  ani  management  to  handle  Just  such  problems.  Whether  It  can  do  so  may 
quick.' /  be  decided  from  analyses  presented  in  this  report  section  concerning  the 
time  required  for  coordination  and  the  unjustifiable  number  of  existing  limited- 
coordination  specifications. 

Now,  we  may  ask,  "Why  are  practically  all  military  parts  specifications  out 
of  cate,  as  far  as  industry  know-how  Is  concerned?"  In  seeking  a  roply,  we  find 
a  responsibility  assignment  la  specification  organization  and  manacomont  which 
permits  plans  for  future  revision  and  development  of  specifications  to  be  generated 
at  a  nontechnical  level,  with  no  suitable  over-all  development  program  to  ensure 
consonance  between  the  various  plans  submitted  by  the  many  specification-writing 
groups.  It  Is  true  that  those  plans  are  roviowed  several  tlmes--and  finally  at  a 
high  level,  but  whothor  such  roviowa  are  meaningful  and  productive  can  quickly  bo 
determined  If  ono  asks  for  a  copy  of  the  genoral  program  to  keep  specifications  up 
to  date  with  the  stato  of  the  art  or  by  rovlowtng  the  summary  Information  contained 
la  this  report  concerning  needed  changes  to  military  parts  specifications  to  bring 
them  up  to  date. 
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Certain!/,  tr.o  moot  eerie us  problem  relating  to  military  parts  apectflcatlor-S 
la  the  r.eo  l  for  suitable  aceclflcatlon  management.  Section  2  cf  thla  voluroo  pre- 
senta  recommendations  leading  to  the  establishment  of  a  suitable  management 
organization  for  military  parts  specifications. 

3. 2  Specifications  for  Reliable  Part3. 

Military  parts  specifications  have  been  subjected  to  a  considerable  amount  of 
criticism  in  recent  years  by  persons  see!cir.g  to  Improve  the  reliability  of  military 
electronic  equipment.  The  criticism  Is  partially  Justified.  In  general,  the  claim 
that  the  specification  does  not  represent  reliable  item3  can  be  traced  (1)  to  a  failure 
to  ensure  fall  compliance  with  the  specification  requirements  or  (2)  to  the  applica¬ 
tion  of  the  Item  In  a  way  that  was  never  Intended  and  was  not  covered  by  the  speci¬ 
fication's  requirements. 

Nevertheless,  It  Is  felt  that,  to  a  considerable  degree,  the  basic  specification 
structure  and  administration,  as  well  as  the  excessive  time  required  to  modify  or 
supersede  specifications,  contribute  to  military  specifications1  Inability  to  provide 
the  required  degree  of  protection  and  to  Keep  pace  with  the  state  cf  the  art.  It  is 
believed  that  a  major  overhaul  In  the  present  system  of  specification  preparation 
and  administration  and  the  Injection  of  some  radical  new  concepts  in  specification 
structure,  objectives  and  requirements  are  long  overdue. 

To  assure  with  a  reasonable  degree  of  confidence  the  attainment  of  the  ex¬ 
tremely  low  failure  rates  of  electronic  parts  demanded  by  current  military  equip¬ 
ments  requires  the  testing  of  such  large  quantities  of  parts  that  It  Is  Impractical  to 
require  this  assurance  on  a  lot-by-lot  basis.  It  is  therefore  proposed  to  Include  in 
parts  specification  some  new  procedures  for  the  accumulation  of  life-test  data,  over 
an  extended  period  of  time,  from  the  tests  carried  out  in  the  acceptance  inspection. 
Failure  rates  are  to  be  computed  from  these  accumulated  data.  The  specification 
will  establish  several  graduated  failure-rate  levels. 

When  sufficient  data  have  been  accumulated  to  assure  with  a  high  degree  of 
confidence  that  the  actual  failure  rate  Is  less  than  one  of  the  established  levels,  the 
manufacturer  may  apply  to  the  qualifying  agency  for  certification  of  this  failure  rate. 
As  the  several  failure-rate  levels  art  represented  by  difforont  part  numbers,  this 
certification  permits  the  manufacturer  to  supply  items  under  the  applicable  number. 
Certification  to  retained  only  as  long  as  the  manufacturer  maintains  the  established 
failure  rate.  Thus,  the  certification  assures  the  purchaser  that  the  applicable 
failure-rate  level  has  been  demonstrated  and  to  being  maintained. 

3.3  Procedure  for  Qualification  Approval 

Currant  procedures  tor  qualification  approval  provide  little,  if  any,  assurance 
that  items  purchased  and  roprosontod  on  Qualified  Products  Lists  can  or  will  be 
suppllod  by  the  manufacturer  In  accordance  with  the  specification. 
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'{■;  *nt  r^ferenc'' :  fo  qualification  approval  a.;  ino  granting  a  "birth  certificate.  ” 
(•'.fortunately,  equipment  manufacturers,  unaware  o !  thin  situation,  have  too  often 
placed  llWounded  confidence  lr.  the  QPL  listing,  accepting  It  a3  an  assurance  of  the 
product's  ability  to  meet  all  specification  requirements. 


To  correct  this  situation,  a  number  of  changes  are  proponed  In  the  procedures 
for  setting  up  and  maintaining  the3e  lints.  Because  these  changes  will  not  only 
require  evidence  of  the  Inherent  ability  of  the  product  to  meet  specified  requirements 
but  will  also  provide  reasonable  assurance  of  the  manufacturer's  ability  to  produce 
and  deliver  satisfactory  ltem3  without  excessive  delay,  It  Is  proposed  that  the  listing 
be  called  "Approved  Sources  of  Supply  for  Qualified  Electronic  Farts  List."  This 
proposed  new  name  for  the  present  QPL  is  used  in  the  discussion  of  this  report's 
recommendations  solely  to  prevent  confusion. 


The  principal  changes  In  the  proposed  concept  of  qualification  are  as  follows: 

(1)  In  addition  to  submitting  qualification  test  data  or  samples  for  Initial 
approval,  the  manufacturer  must  provide  evidence  that  he  possesses  adequate  pro¬ 
duction  and  test  facilities  and  that  he  employs  sound  procedures  for  process  and 
quality  control. 

(2)  The  specifications  shall  provide  for  separate  Identification  of  Items 
having  different  established  failure-rate  levels  by  using  different  part  numbers. 

(This  point  Is  discussed  more  fully  la  the  report  on  Subtaslc  1,  section  4. )  The 
initial  qualification  approval  must  be  based  on  tests  of  an  adequate  number  of  units 
for  a  long  enough  period  to  establish  with  a  prescribed  confidence  that  the  failure 
rate  Is  lower  than  the  highest  level  provided  by  the  specification.  The  units  tested 
should  be  representative  of  production  quality.  Approval  for  the  •  failure-rate 
level  is  based  upon  data  accumulated  from  the  lot  acceptance  tes. 

(3)  Assurance  of  continued  conformance  with  the  specification  must  be 
provided  to  the  qualifying  agency,  thus  ensuring  the  continual  re -evaluation  of  the 
approval.  This  Is  done  by  routine  submission  of  test  data  collected  during  acceptance 
Inspection.  The  need  for  re-evaluation  of  approval  (either  for  the  certification  of 

a  lower  failure-rate  level  or  the  loss  of  certification  of  the  currently  held  level)  will 
be  determined  on  the  basis  of  the  test  data  submitted. 


3. 4  Acceptance  Inspection. 

Current  practice  In  acceptance  Inspection  relies  heavily  on  statistical  sampling 
plans.  The  relationship  between  the  probability  of  acceptance  and  lot  quality  doponda 
on  the  size  of  sample  tasted  and  the  number  of  failures  permitted,  and  It  Is  com¬ 
pletely  described  by  the  operating  characteristic  (o.c.)  curve  for  the  combination 
aelectad.  Thera  Is  an  Infinite  number  of  possible  combinations  of  sample  size, 
allowable  failures  and  lot  sizes. 
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consideration  to  the  matter  of  consumer  protection. 


No  specific  recommendations  on  the  most  desirable  approach  ai  *  ~ade  •  ere, 
3lnce  this  problem  13  now  being  studied  Intensively  by  the  JT-li  Cc  era  u  ..  the 
Joint  Electron  Device  Engineering  Council  of  the  Electronic  L-.dustrles  Association 
and  the  National  Electrical  Manufacturers  Association.  It  is  feit  that  a  standardised 
method  for  setting  up  consumer-protecting  sampling  plans  should  be  adopted  for 
military  specifications  for  electronic  parts,  when  the  JT-11  recommendations  be¬ 
come  available,  they  should  be  promptly  considered  for  standardisation. 


The  acceptance  Inspection  required  by  the  specification  13  mearingless  unless 
some  m.y  is  provided  to  ensure  that  the  inspection  requirements  are  enforced.  It 
is  the  policy  of  the  Department  of  Defense  that  the  prime  contractor  is  responsible 
for  assuring  himself  and  the  government  that  the  requirements  of  all  applicable 
specifications  are  complied  with  (see  Specification  MEL-Q-3358).  It  therefore  follows 
that  the  prime  contractor  must  obtain  some  tangible  evidence  chat  the  required  In¬ 
spection  has  been  carried  out.  To  require  him  to  assign  his  perso.mel  to  the  parts 
manufacturer's  plants  would  be  expensive  in  terms  of  manpower.  Furthermore, 
since  meat  parts  manufacturers  supply  to  many  prime  contractors,  each  parts 
manufacturer  would  be  required  to  deal  with  a  large  number  of  purchasers'  repre¬ 
sentatives.  To  reduce  the  need  tor  such  assignment  of  the  prime  contractor's 
personnel  and  the  resultant  costs  to  the  government,  it  Is  proposed  that  all  parts 
specifications  require  the  manufacturers  to  provide  test  data  on  the  parts  supplied. 
This  should  Include  all  data  from  the  specified  acceptance  Inspection,  certified  by 
a  responsible  representative  of  the  manufacturer. 

3. 5  Design  and  Procurement  Documentation. 

The  organizational  format  in  which  physical  and  performance  requirements  of 
Items  are  presented  in  present  military  documentation  Is  not  optimum  for  either 
industry  or  the  Military  Services.  The  military  parts  specifications  at  present 
employ  a  confusing  variety  of  subsidiary  documents  to  detail  the  Items  covered  under 
these  specifications. 


The  format  described  by  the  various  Manuals  and  Outlines  of  Form  M2C2, 
M203,  M204,  M205  and  M206  13  Inadequate  for  the  following  reasons:  (1)  It  does 
not  define  the  relationship  between  the  various  documents;  (2)  it  does  not  assure  that 
descriptive  Information  required  for  design  and  procurement  is  placed  on  specific 
documents  as  completely  as  to  needed  by  tho  user;  and  (3)  it  doe3  not  provide  a 
ready  moans  of  identifying  othor  related  documents  when  only  one  la  available.  As 
a  consequence,  there  has  been  consldorablo  confusion  In  tho  mannor  of  Identifying 
Items  for  callout  on  assombly  drawings,  tho  propor  Identification  for  procurement, 
the  Identification  of  othor  rotated  specifications  and  documents,  and  oven  tho  propor 
mannor  of  marking  tho  ltum3.  This  situation  has  resulted  in  a  tremendous  duplica¬ 
tion  of  offort  botwoon  campanil's  that  maintain  their  own  standards  departments  and 
has  forcod  thorn  to  sot  up  their  own  documentation  to  mnko  tho  military  specifica¬ 
tions  uunblo. 


1  | 

t 


H 


u.y  v-":f 
lln  1 

throughout  th  >  s  t»  r.  da r 'J 1  za. 1 1  o n  procedure. 


•'  IT',  . #»J •  *i  ***  *  *f  k  »  *•  t*  <  *»  , *  -jts  >  .*  .  I*,  y  i  *<j  . 

r'"julr  t.  -i*-  .h<  ■•*.;,  e.lll,..ry  :*  m  lards,  up  .1  Iiar.r 

iccurr.'.-r.h:.  ."uch  a  "n  wc-il-1  prv/1  .*«  a  <“7  that  wo  :I1  r<‘\\: 


The  subsidiary  documents  associated  with  the  specification  she -11  Include 
(’ )  Item  requirements  sheets,  providing  all  the  detailed  requirements  necessary  for 
use  of  the  specification  in  prevurement  of  the  specific  items  listed  therein,  (2)  mili¬ 
tary  standard  sheets,  Indicating  those  Items  designated  as  standard  items  by  the 
military,  and  (3)  application  data  sheets  containing  all  the  information  required  for 
proper  use  of  the  part  In  equipments,  rurthermcrc,  these  documents  should  be 
printed  In  a  manner  permitting  the  users  to  reproduce  them  easily. 


3.9  Contractual  Data  Requirements. 


In  addition  to  furnishing  complete  sets  of  engineering  drawings,  contractors 
are  normally  required  to  submit  their  purchased  part  specifications  and  substan¬ 
tiating  test  data  to  the  procuring  activities  for  review  and  approval. 


Since  most  of  the  items  defined  by  such  company  specifications  are  used  widely 
In  the  contractor's  equipment  designs,  most  contractors  have  seen  fit  to  designate 
these  Items  as  company  standards  and  to  maintain  manuals  containing  these  speci¬ 
fications  and  standards  for  use  by  their  designers.  Also,  some  contractors  have 
established  formaL  methods  of  reviewing  equipment  designs  for  the  purpose  of  pro¬ 
moting  and  controlling  the  use  of  contractor’s  standard  items. 


Contractor's  specifications  and  standards  clearly  represent  a  tremendous 
resource  for  military  agencies  in  their  preparation  of  revised  and  new  specifications. 
However,  this  presents  certain  immediate  difficulties,  because  the  volume  of  the 
material  Is  so  great  that  It  can  be  used  effectively  only  by  machine  methods  for 
storing,  comparing  and  retrieving  the  data.  Further,  the  data  may  be  difficult  to 
compare,  even  by  machine  methods,  unless  there  Is  more  uniformity  in  format  and 
more  standardization  of  test  methods. 


It  Is  believed  that  the  use  of  contractor's  specifications  can  be  immediately 
reduced  by  upgrading  existing  military  specifications  with  respect  to  environmental 
requirements. 


Acceptance  Inspection  Practices. 


Many  contractors  have  had  the  experience,  atone  time  or  another,  of  running 
tests  in  accordance  with  a  military  specification  on  supposedly  military  parts  and 
finding  several  failures  In  compliance.  The  same  contractors  (and  the  Military 
Departments),  however,  must  ofton  bear  part  of  the  blame  for  this,  because  they 
did  not  Insist  that  all  tho  specification  tost  requirements  bo  carried  out  by  tho  parts 
manufacturer  prior  to  shipment  of  tho  parts.  It  would  seem  Uiat  there  woula  bo 
no  question  that  all  tost  requirements  would  automatically  bo  oarrl-d  out  by  manu¬ 
facturers  soiling  parti  to  military  specifications.  Tho  fact  Is,  however,  stive 
running  these  tents  Is  expensive  and  since  few  buyers  Insist  on  such  testing,  few 
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out  (especially  In  tho  area  of  reduction  of  c..;t  to  Lie  Defense  tudjet),  Lie  military 
Inspectors  can  provide  moat  valuable  anjLiUr.co.  By  monitorin';  and  reporting, 
thoy  caa  eliminate  duplication  In  tho  efforts  of  many  bayou  i.i  xinunng  Liat  tn«  tests, 
as  evidenced  by  tna  tent  data,  supplied  have  been  properly  conducted. 


3.8  Procedures  for  Coordinating  Specifications. 


Unless  radical  changes  ran  be  made  In  the  procedures  now  established  for 
coordinating  specifications,  we  must  accept  (1)  coordinated  specifications  one  to  one 
'  and  one-half  years  out  ot  cate,  (2)  a  continuing  growth  in  *he  number  of  limited- 
coordination  specifications  and  (3)  a  vast  increase  In  the  ttse  of  nonstandard  parts. 

An  ap- to -date  specification  covering  a  type  of  new  item  with  potential  multiple 
nsec  can  be  written  in  a  matter  of  weeks.  Yet,  based  on  the  present  established 
procedures,  11  would  be  extremely  unlikely  that  coordination  agree tueat  could  be 
reached  and  the  specification  made  available  to  the  military  contractor  in  les3  than 
18  month*.  This  specification,  which  was  a  good,  one  initially.  Is  then  unsuitable 
for  use  when  issued  because  of  the  delay. 

The  recent  rapid  growth  in  the  number  cf  limited-coordination  specifications 
stems  directly  from  tMs  delay  and  from  the  desire  cf  each  Military  Service  to 
supply  a  measure  cf  guidance  la  part?  selection  to  its  contractors.  The  general 
unhappiness  with  the  coordination  procedures  felt  by  both  the  Military  Services  and 
industry  has  culminated  in  a  recent  almost  unbelievable  public  statement  by  a 
representative  cf  a  Military  Service  that  *it  pro  posse  to  continue  issuance  of  its  own 
limited  coordination  specifications  with  only  e.  token  effort  toward  their  coordination.’ 

The  confusion  and  increased  cost  to  the  Defense  budget  resulting  from  limited- 
coordination  specifications  are  very  real  to  all  contractors  who  have  contracts  with 
all  threw  Military  Serricea.  Many  examples  can  be  cited  of  duplicative  limited- 
coordlBation  specifications  that  caused  complete  re  testing  of  identical  items.  The 
very  sad  fact  is  that,  in  spits  of  the  duplicating  specifications  and  the  duplicate 
testing,  the  parts  manufacturers  make  only  a  single  type  of  Item,  which  they  supply 
(and  also  sejutrataly  test)  to  all  the  duplicating  speclilcatiorn. 

Can  thare  be  any  doubt  concerning  tho  need  for,  and  benefits  of,  coordination? 
3. 8  Procurement  Practices. 

There  is  no  doubt  that  the  logistic  problems  of  the  Military  Services  relating 
to  electronic  parts  exert  a  significant  effect  on  the  over-ail  reliability  of  tho  military 
electronic  equipment.  Even  when  the  equipment  manufacturer  u3os  only  standard 
parts,  thurtt  are  very  real  logistic  problems  In  trying  to  keep  tho  stock  bln3  flliod 
with  "frosh"  stock.  (II  has  boon  estimated  tho  coat  to  the  Military  Services  of  pur¬ 
ging  the  stock  bins  of  "old"  electronic  parts  would  be  100  million  dollars.)  When 
the  equipment  contractor  uaoo  norstamiard  parts,  tha  logistic  probloms  become 
almost  Insuperable. 
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3<  10  Sources  and  Source  Lb  ting  of  Technical  Iriormatlc 

A  considerable  amount  of  research  and  development  on  electron  devices  (tube3 
and  semiconductors)  and  electronic  part3  Is  sponsored  by  agencies  within  the  De¬ 
partment  of  Defense.  Interim  progre33  reports  and  final  development  reporto  on 
these  activities  arc  normally  required  b7  the  sponsoring  military  agency,  all  of 
which  are  listed  by  the  Armed  Services  Technical  Information  Agency,  including 
abstracts  for  the  unclassified  (security)  reports.  Further,  some  of  the  unclassified 
reports  are  listed,  with  abstracts,  In  the  U.S.  Government  Research  Reports. 

The  kind  of  data  of  concern  In  this  study  for  Items  defined  by  military  speci¬ 
fications,  however,  is  properly  characterized  as  "evaluation"  and  Is  normally  not 
considered  as  "research  and  development";  therefore,  It  Is  rarely  obtained  from 
studies  sponsored  under  the  research  and  development  effort  Such  data  as  exist 
are  obtained  from  qualification  testing  (in-plant  or  in  government  laboratories)  or 
from  special  evaluation  studies  sponsored  by  military  agencies,  either  as  in-house 
work  or  by  contract. 


For  several  years,  certain  trade -association  committees  have  addressed 
themselves  to  the  task  of  preparing  Industry  specifications  and  related  documents 
(1)  for  items  currently  available  but  not  defined  by  military  specifications  and  (2) 
for  items  not  available  but  needed  to  satisfy  the  current  design  demand.  Related  to 
tne  latter  effort  is  the  need  for  the  military  to  recognize  Industry  standards  and 
specifications  as  a  bona  fide  technical  description  acceptable  for  procurement  of 
industry  standard  items  by  contractors  (and  subcontractors)  and  by  the  government 
“  ii  j  Pro':urement-  TMs  need  was  recognized  by  the  Department  of  Defense  and 
resulted  in  the  current  coordination  effort  on  an  Instruction  relating  to  the  use  of 
standardization  documents  issued  by  industry  groups. 


^Pacification  and  standardization  projects  of  the  trade  association  relate 
to  items  needed  by  the  electronic -equipment  industry  for  use  In  their  military  equi*;- 
*-  assigns;  and  substantiating  dala  showing  that  articles  exist,  as  defined  by  the 
'peciflccMons  and  standards,  are  generated  for  the  most  part  by  the  users 
't  limite ;  *  ^-t  hv  the  manufacturers. 


3.11  Exchar '  •  •  ohnlcal  Data. 

There  can  1  -  tittle  doubt  of  the  potential  good  inherent  In  proposals  for  the 
exchange  of  technical  data.  The  actual  benefits  to  be  realized,  however,  from  any 
such  exchange  depend  on  several  factors.  Tha  first  factor,  and  probably  the  moat 
Important  for  maximum  ro&llzablo  benoflts,  is  tha  mechanics  of  the  system  of  In¬ 
formation  storage,  retrieval  and  dlaoomination.  Too  much  complexity  can  result 
in  little  or  no  usa  qf  what  may  be  oxtroraoly  valuable  Information.  The  second 
factor  In  the  need  to  collect,  store  and  rotxlove  Information  is  a  standard  format 
and  standard  test  procoduroa.  The  output  of  electronic  accounting  machines  can 
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4.  REPOHT3  ON  3UDTASK  ASSIGNMENTS 
SUBTASK  1 
1.  Summary 

A  new  concept  has  been  developed  for  the  Incorporation  of  procedures  for  de¬ 
termining  failure  rates  Into  component-parts  specifications.  Utilizing  acceptance 
test  data,  these  procedures  provide  a  means  for  failure-rate  certification  when 
sufficient  data  have  been  accumulated.  These  procedures  have  been  incorporated 
Into  a  prototype  capacitor  specification  and  prototype  specification  sheets  for  a  mini¬ 
ature  receiving  tube.  In  addition,  the  technical  changes  required  to  incorporate 
the  concept  into  the  current  military  specification  on  relays  are  Included.  (All 
these  documents  are  published  in  Volume  n  of  this  report. ) 


2.  Statement  of  Mission 

This  subgroup  was  assigned  the  responsibility  for  the  "incorporation  of  reli¬ 
ability  requirements  in  specifications,  including  test  requirements  necessary  to 
assure  the  reliability  levels  defined. "  The  subgroup  found  it  necessary  to  limit  its 
efforts  to  the  formulation  of  concepts,  principles  and  techniques  for  reliability 
assurance  in  the  preparation  of  part  procurement  specifications.  No  effort  was 
devoted  to  detailed  acceptance  limits  for  various  types  of  parts,  nor  to  determining 
or  evaluating  new  performance  tests  necessary  for  military  use  of  the  parts. 


3.  Basic  Premises 

The  efforts  of  the  subgroup  were  based  on  the  following  premises: 

(1)  That  the  parts  manufacturer  Is  responsible  for  assuring  the  parts  user 
that  his  product  conforms  to  the  requirements  of  the  applicable  military  procurement 
specification. 

(2)  That  parts  manufacturers  can  be  provided  with  facilities  where  neces¬ 
sary  to  perforin  product  acceptance  test3  in  accordance  with  the  requirements  of 
the  applicable  part  acceptance -test  specifications.  This  Is  necessary  If  we  are  to 
achieve  any  significant  reduction  In  the  amount  of  acceptance  testing  performed  by 
parts  users. 

(3)  That  part  acceptance -tost  specifications  are  baood  on  some  level  of 
acceptable  part  reliability  and  that  the  specification  for  a  particular  part  contains 
tho  necessary  measurement  testa  and  acceptance  standards  to  give  assurance  of 
that  particular  lovol  of  reliability. 

(•1)  That  effort  1s  directed  toward  formulating  specifications  that  can  tie 
used  for  acceptance  testing  of  parts  that  can  be  currently  manufactured  In  quantities 
and  In  a  time  period  sufficient  for  military  needs.  Military  part  performance 
requirements  that  cannot  be  satisfied  by  currently  manufactured  parts,  either 
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(o)  That  effort  will  bo  confined  to  the  long-life,  i.omlnal-str°33  types  of 
military  application.'!.  Dependence  will  bo  placed  upon  application  Information  and 
reliability  trade-off  gulden  on  any  given  part  for  the  short-life,  hlgh-strcs3  types 
of  applications.  The  reason  for  thl3  Is  that  the  problem  will  be  entirely  too  great 
for  the  current  effort  If  the  many  and  various  hlgh-stress  types  of  applications  are 
considered.  In  the  main,  the  total  quantity  of  parts  consumed  in  these  applications 
to  date  Is  believed  to  be  quite  small  to  comparison  with  the  more  conventional  uses 
of  parts. 


(0)  That  primary  consideration  will  be  given  to  the  specification  controls 
that  affect  the  operation  of  parts  with  respect  to  time,  as  contrasted  with  the  initial- 
operation  (or  zero-hour)  type  of  controls.  The  reason  here  Is  that  the  primary  con¬ 
cern  is  to  assure  part  reliability  and  that  the  direct  approach  to  this  is  through 
suitable  llfe-te3t  controls.  The  initial-test  (or  zero-hour)  type  of  control,  to  valu¬ 
able  to  assure  product  Interchangeability,  and  It  to  otherwise  necessary  in  the  event 
that  life  tests  under  certain  operating  conditions  are  impractical.  Conceivably,  this 
could  be  the  case  with  the  impact  type  of  shock  tests  or  other  severe  environmental 
conditions. 

(7)  That  the  lot-acceptance  type  of  specification  controls  will  be  considered 
for  parts  that  normally  lend  themselves  to  a  high  production  rate  or  to  an  essentially 
continuous  production,  even  though  at  a  relatively  low  rate.  In  the  latter  case,  the 
specification  may  employ  a  process -average  or  a  quality-history  brpe  of  concept. 

(8)  That  reliability  assurances  will  be  incorporated  for  various  leveto  of 
stress  severity  (both  circuit  and  physical  environments)  that  cover  the  bulk  of 
military  requirements.  Reliability  tests  will  be  optimized  by  statistical  techniques. 


4.  Incorporation  of  Failure  Rates  Into  Specifications 
4. 1  Proposed  Basic  Concept  for  Reliability  Specification. 

To  assure  the  high  orders  of  reliability  of  a  part  demanded  by  current  military 
equipments  with  a  reasonable  degree  of  confidence,  such  large  quantities  of  parts 
must  be  tasted  that  it  Is  entirely  Impossible  economically  to  require  this  assurance 
on  a  purely  lot-by-lot  basis.  It  to  obvious  that  any  specification  concept,  no  matter 
how  correct  from  a  statistical  standpoint,  to  doomed  to  fall  if  it  does  not  taka  ade¬ 
quate  cognizance  of  economic  practicability.  It  to  therefore  evident  that  the  assur¬ 
ance  of  parts  reliability  can  only  be  achieved  by  building,  on  a  long-time  basis,  a 
confidence  to  the  quality  history  of  a  manufacturer's  product.  From  this  It  was 
concluded  that  the  major  change  In  concept  necessary  to  provide  for  reliability 
assurance  to  the  accumulation  of  failure  Information  over  an  extended  period  of 
time. 


While  this  concept  will  probably  require  the  modification  of  current  procedures 
for  qualification  approval  and  acceptance  testing,  the  changos  In  general  will  be 
minor,  primarily  Involving  the  modification  of  sampling  plans  to  make  them  con¬ 
sistent  with  the  failure-rate  levels  specified. 
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Tho  accumulation  of  failure  data  over  an  eater/led  p-.-riod  of  time,  however, 
rnak<vj  it  necessary  to  Include  In  tho  specification  entirety  new  procedure's  *o  pro- 
for  fi"  go.*  era  tier.  and  recording  of  Lho  data  and  t ha  determination  and  certifi¬ 
cation  of  failure  rates.  It  Li  fait  that  tho  primary  source  of  these  data  should  bo 
the  regular  accoptanee  tosto  performed  in  connection  with  production  inspection.  In 
addition,  by  requiring  the  extension  of  life  teste  beyond  their  normal  end  point  to 
a  maximum  determined  by  the  expected  life,  or  by  increasing  the  number  of  ltem3 
tested,  the  necessary  data  can  be  generated  more  rapidly.  From  these  data,-  failure 
rates  may  be  computed  with  a  high  level  of  confidence. 

When  the  computed  failure  rate  is  less  than  one  of  the  specified  levels,  the 
manufacturer  should  be  certified  as  a  supplier  of  the  component  part  at  thte  failure 
level.  The  specification  should  provide  for  a  series  of  failure  levels  in  steps 
graduated  down  to  the  lowest  practicable  figure. 

1.2  Examples  of  Reliability  Specifications. 

To  demonstrate  the  principles  embodied  in  the  basic  concept  Just  described, 
studies  were  conducted  to  determine  the  changes  that  would  be  required  in  the  cur¬ 
rent  applicable  military  specifications  for  three  specific  types  of  electronic  parte 
in  order  to  incorporate  this  concept  Into  the  specifications.  The  parts  selected 

were: 


Paper-dielectric  capacitors 
Miniature  receiving  tubes 
Relays 

These  three  items,  representing  high,  medium  and  low  production  rates,  were 
selected  to  provide  features  representative  of  the  wide  range  of  problems  inherent 
In  the  subgroup's  mission. 

The  studies  were  conducted  by  three  separate  groups  of  representatives  chosen 
from  Industry  and  the  military.  They  followed  a  unified  approach,  which  is  outlined 
in  Volume  U,  section  1,  "Concepts  and  Objectives  for  the  Preparation  of  Prototype 
Specifications  Embodying  Failure-Rate  Requirements. B  This  document  describes 
on  Integrated  procedure  for  the  Initial  qualification,  acceptance  and  failure-rate 
certification  of  parts,  essentially  consisting  of  the  following  three  parts: 

(1)  Qualification  approval,  employing  sufficient  samples  in  tho  life  tests 
to  establish  that  the  failure  rate  is  less  than  a  specified  nominal  figure:  Since  this 
is  only  a  one-time  test  which  permits  the  manufacturer  to  initiate  the  data-accumu- 
latlon  process,  the  nominal  failure  rate  will  be  somewhat  high  and  the  confidence 
level  of  the  determination  low  (80  percent  or  less).  The  actual  sample  size  and  test 
duration  will  be  based  mainly  on  economic  practicability.  In  these  as  well  as  the 
acceptance  and  failure-rate  certification  tests,  maximum  use  is  made  of  accelera¬ 
tion  factors  established  on  the  best  available  data,  experience  and  engineering 
Judgment. 


(2)  Acceptance  teats,  performed  on  a  lot-by-lot  basis,  with  sample  sizes 
set  to  provide  a  reasonable  confidence  level  that  the  failure  rata  is  less  than  some 
nominal  value:  For  the  failure-rate  level  at  which  Initial  qualification  approval  Is 
Granted,  the  confidence  level  is  higher  than  that  employed  tn  the  qualification  tests 
(80  to  80  percent).  For  the  lower  failure  rales,  certification  of  the  established 
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(3}  Fallaro-rato  tosto.  providing  for  the  accumulation  of  life  test  data 
over  an  extended  period  of  time:  Thc3e  data  are  generated  from  the  acceptance  testa 
and  extensions  of  them.  Failure  rates  are  computed  from  the  accumulated  data  at 
a  high  (90  to  95  percent)  confidence  level.  Beginning  with  the  Initial  failure  rate 
specified  for  the  qualification  tests,  a  series  of  graduated  failure-rate  levels  is 
established.  It  is  provided  that,  when  the  computed  failure  rate  falls  below  one  of 
the  established  limits,  the  manufacturer  will  receive  certification  of  this  from  the 
qualifying  activity.  This  document  further  provides  that  five  "established  failure 
levels"  should  be  used,  the  highest  to  be  no  higher  than  that  presently  specified  in 
the  current  corresponding  military  specification.  The  other  levels  should  be  1,  0. 1, 
0. 01  and  0. 001  percent  per  1000  hours.  The  instructions  indicated  that  these  levels 


were  to  be  applied  at  the  maximum  rated  operating  conditions.  Further,  the  groups 
were  instructed  to  provide  derating  information,  if  possible,  in  cases  where  the 
lowest  failure  rates  given  above  were  either  beyond  the  state  of  the  art  at  maximum 


rated  conditions  or  where  it  was  impractical  to  establish  the  level  directly  because 
of  the  unit  hours  of  test  required. 


In  formulating  guidelines  for  these  studies,  consideration  was  given  to  the 
application  of  new  sampling  plans  to  the  initial  (Group  A)  tests  of  the  specification, 
instead  of  using  Standard  MIL -STD-105.  At  present  many  groups  are  seriously 
thinking  of  abandoning  or  modifying  the  acceptable  quality  level  (AQL)  of  "producer’3 
risk"  philosophy  in  favor  of  sampling  plans  based  on  either  the  lot  tolerance  percent 
defective  (LTPD) — or  "consumer’s  risk"—  concept,  or  on  the  acceptable  defective 
level  (ADL)— or  "indifference  point"— concept.  In  view  of  the  amount  of  attention 
being  given  to  this  problem  by  other  groups,  no  attempt  was  made  to  incorporate 
any  of  these  new  philosophies  into  the  acceptance  test  procedures,  other  than  those 
for  life  tests.  It  is  recognized,  however,  that  in  future  formulation  of  procurement 
specifications  the  adoption  of  such  sampling  plans  must  be  seriously  considered. 


Volume  n,  section  4,  is  a  complete  specification  covering  capacitors  of  a  type 
currently  covered  by  Specification  MIL-C-14157.  This  prototype  specification  in¬ 
cludes  not  only  the  concept  discussed  herein  but  also  reflects  the  changes  in  format 
and  administrative  procedures  recommended  by  Subgroups  ST-2  and  ST-4.  Section 
6  of  Volume  n  indicates  the  type  of  technical  changes  required  in  Specification 
MIL-R-5757C  to  incorporate  the  failure-rate  concept  and  states  the  technical  basis 
for  these  changes.  Section  6  consists  only  of  prototype  specification  sheets  for 
Sped  .icatlon  MIL-E-1  that  are  required  to  apply  the  failure-rate  concept  to  one 
type  <  ’  miniature  receiving  tube. 

It  must  be  clearly  recognized  that  these  prototype  specifications  (In  sections 
4,  5  and  0  of  Volume  II)  and  the  associated  item  requirements  sheets  were  prepared 
chiefly  to  exemplify  the  application  of  the  basic  concept  to  an  actual  specification. 

To  do  this  In  the  time  available,  it  was  necessary  to  make  many  compromises  in 
details  which  either  are  not  pertlnont  to  the  basic  objectives  (e.g. ,  details  of  teat 
procedures,  dimensional  requirements)  or,  while  pertlnont,  are  a  aomowhat  arbi¬ 
trary  choice  (e.g.,  the  confidence  levels  for  acceptance  testa  in  the  capacitor 
specification).  These  details  can  and  should  he  resolved  in  tho  normal  processes  of 
specification  coordination.  Tho  prototype  specifications  are  not  Jnlonded  to  be  con¬ 
sidered  as  first  drafts  of  revised  specifications  for  the  ports  concornod  nor  to  be 
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re  furred  to  "f''c!flc:itlon  /roup  for  coordination  and  promulgitlon  an  now  or  revised 
v ’clflc  Ulons  for  !h,,::o  parts,  Rather,  they  aro  meant  to  servo  an  examples  of  thl3 
r.p-u  approach  to  specifying  reliability  and  to  nuldo 

t. . .  .n  the  fcr.o.ulat'./d  .,f  all  now  parts  specifications.  It  must  also  bo  rocogntsod 
that,  since  tho  prototypo3  aro  primarily  tntondod  to  Ulustrato  principles,  tho  appli¬ 
cation  of  those  principles  to  specifications  for  other  types  of  parts  will  necessarily 
call  for  some  modification  of  the  technical  and  administrative  details  to  fit  the 
specific  item. 


To  Illustrate  this,  the  life-test  (failure -rate)  sampling  plans  for  the  prototype 
specifications  were  developed  to  exemplify  a  method  for  proving  conformance  with 
the  reliability  requirement  In  parts  specifications.  The  technology  of  life-test 
sampling  plans  Is  experiencing  rapid  development,  with  continual  improvement. 
Therefore,  users  of  this  report  must  bear  in  mind  this  rapidly  changing  technology 
and  make  use  of  the  latest  statistical  techniques  and  improved  plans. 


5.  Conclusions 

.  „  j1)  Thc  ^lability  of  electronic  parts  can  be  measured,  specified  and  con¬ 
trolled  by  means  of  suitable  procurement  specifications. 

Reliability  assurance,  as  related  to  the  procurement  of  electronic  parts 
of  high  orders  of  reliabilities,  requires  the  life  testing  of  large  quantities  of  parts 
»r  long  periods  of  time,  testing  time  and  quantity  depending  upon  the  service 
Sffl^Uni9  f0F  WMsh  reliabillty  aS3arance  *  desired  and  the  required  level  of 

>  electronic-parts  manufacturing  Industry  do  not  at 
present  have  the  facilities  for  the  performance  of  life  tests  on  a  scale  that  will  en¬ 
sure  the  levels  of  reliabillty  that  parts  can  now  attain. 

n™^ltL?.°.rder  k;Lorpor*t?  r«H*bUity  requirements  in  specifications,  new 
P.,  c,  needed  to  provide  a  mechanism  for  accumulating  a  large  amount  of 

life  test  data  on  the  product  and  Us  effective  usa. 

W  IR*1  can  be  accumulated  by  maintaining  a  continuous  record.of  acceptance 
tests,  supplemented  by  dttonal  test  data  if  necessary. 

,  11  ^  J*1?  3Pfc location  of.  failure  rate  should  be  based  on  discrete,  graduated 

level®  •  There  should  be  a  means  of  certifying  the  manufacturer  when 
he  aubmits  adequate  evidence  that  the  indicated  failure -rate  level  has  been  achieved. 
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6.  Recommendations 


It  la  recommended  that: 

(1)  The  Department  of  Defense  1S3U8  the  necessary  directives  to  Implement 
the  recommended  program,  based  on  the  concepts  for  the  establishment  of  part3 
failure-rate  levels  contained  la  this  report,  and  to  bring  all  military  electronic-parts 
specifications- up  to  current  design  demand. 

(2)  The  prototype  specifications  and  the  description  of  the  basic  concepts  and 
objectives  and  explanatory  material  contained  In  Volume  n  should  be  forwarded  to 
activities  that  prepare  military  specifications  for  guidance  In  the  formulation  of  new 
and  revised  parts  specifications. 

(3)  The  Department  of  Defense  prepare  and  issue,  for  the  guidance  of  activities 
preparing  military  parts  specifications,  a  manual  of  instructions  containing  the  de¬ 
tailed  procedures  to  be  followed  In  the  revision  of  specifications  In  accordance  with 
the  concepts  and  objectives  developed  In  this  study. 

(4)  The  prototype  specifications  and  explanatory  material  In  Volume  n  also  be 
forwarded  to  Industrial  associations  for  Information  and  guidance. 

(6)  The  concepts  outlined  In  section  1  of  Volume  n  be  applied  to  all  military 
specifications  for  electronic  parts. 

(0)  The  Department  of  Defense  establish  an  appropriate  time  schedule  based 
upon  the  Importance  of  the  specification  and  the  coordination  time;  further,  that  a 
period  of  12  months  be  considered  the  objective  timetable  for  Implementing  these 
procedures  In  specifications  for  Important  Items. 

(7)  ha  the  promulgation  of  directives  and  Instructions,  the  Importance  of  the 
time  element  and  the  need  for  achieving  coordination,  without  necessarily  having 
full  agreement  on  all  detailed  procedures  and  requirements,  be  emphasized. 
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SUB TASK  3 

1.  Summary 

Subgroup  ST-2  Investigated  and  submitted  recommendations  on: 

(1)  Procedures  and  definitions  for  the  establishment  of  approved 
sources  of  supply  for  qualified  electronic  Items  lists 

(2)  Military  inspection  practices 

(3)  Acceptance  Inspection 


2.  Statement  of  Mission 

TWs  subgroup  was  assigned  "specification  requirements  and  test  methods  or 
programs  other  than  those  specifically  directed  to  reliability  considerations,  needed 
to  form  the  basis  of  qualified  products  lists,  acceptance  testing,  etc.  ”  Subsequently, 
the  -work  was  divided  into  three  areas: 

(1)  A  review  of  qualification  approval  procedures  as  they  relate  to  the 
lndlvlcfcial  manufacturer's  products;  this  became  section  3  of  this  report,  "Proce¬ 
dures  and  Definitions  for  Establishing  Approved  Sources  of  Supply  for  Qualified 
Electronic  Parts  Lists.  ” 

(2)  A  study  of  over-all  military  Inspection  procedures,  which  became 
aectlon  4  of  this  report,  "Military  Inspection  Practices. ' 

(3)  A  study  end  evaluation  of  present  specification  Inspection  proce¬ 
dures,  which  became  section  C  of  this  report,  "Acceptance  Inspection.  ” 


3.  Procedures  and  Definitions  for  Establishing  Approved  Source# 
of  Ovpply  lor  Qasltfted  klectronlc  Parts  Ll3i" 

3.1  Statement  of  the  Problem. 

Over  the  past  several  years,  as  a  result  of  a  misinterpretation  of  the  Intent 
and  significance  of  "Military  Qualified  Products  Lists"  (as  applied  to  electronic 
parts),  sa  unwarranted  confidence  In  the  ability  of  electronic  items  so  listed  to  meet 
all  specification  requirements  has  repeatedly  caused  delay:  in  the  delivery  of  Items 
to  using  design  activities  and  has  Increased  the  coat  and  reduced  the  reliability  of 
military  electronic  equipment.  Many  studies,  seme  made  five  years  ago,  3  have 

3Report  of  Signal  Corps  Ad  Hoc  Subcommittee  on  Procurement  of  Component 
Parts  anabncloaure  2',  "PiBcusalonoi  the  frroblom, "  OIOEL-DE-3,  S  July  IBM. 
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shown  tho  no<*il  to  clarify  the  Intent  and  :.lanlflc:i n<~"  Untis  when  applh.l  to 

electronic  Item:).  An  ::uch  clarification  an'l  the  addition  of  other  roquiromentn 
result  In  an  entirely  different  concept  of  "qualification,"  the  title  "Approved 
Source-**  of  "nep'-r  • —  Qur.’.if'. . i  ZIoC‘_u..Io  rju'-*  L...l-)“  n na  ceeri  selected  to  distin¬ 
guish  the  following  approval  procedure  from  earlior  procedures. 

3.2  Summary  of  Policy. 

Because  of  the  possible  variations  In  design  and  quality  of  electronic  ltem3 
and  the  nature  of  the  te3ts  for  them,  and  also  to  Increase  the  assurance  that  there 
will  be  no  delay  (beyond  that  normally  and  routinely  experienced  in  tho  delivery  of 
items  being  purchased),  certain  inspection  is  required  prior  to  the  award  of  a  con¬ 
tract  This  "Qualification  Inspection"  may  be  accomplished  in  advance  of  and  inde¬ 
pendently  at  any  specific  procurement  action.  Manufacturers  of  Items  that  pass 
the  qualification  inspection  shall  be  considered  to  be  "approved, "  and  the  Item  listed 
shall  be  an  Item  with  "Qualification  Approval";  they  shall  be  Identified,  together  with 
the  Items  tested,  on  Approved  Sources  of  Supply  for  Qualified  Electronic  Parts  Lists. 
Since  qualification  approval  will  proceed  on  a  continuing  basis,  the  manufacturer 
and  his  product  will  be  subject  to  constant  re -evaluation,  which  will  mean  his  contin¬ 
uation  on  the  list  or  his  removal  therefrom.  To  establish  an  approved  sources  of 
supply  list  on  an  electronic  part,  a  specification  must  exist  for  it  that  includes  the 
requirement  for  qualification  approval,  specifies  qualification  inspection  and  includes 
the  additional  details  necessary  to  the  administration  of  the  program  for  the  specific 
item. 

3.3  Justification  for  Need. 


The  only  Justification  for  including  qualification  approval  requirements  in  an 
electronic  Item  specification  and  for  establishing  an  approved  source  of  supply  for 
qualified  electronic  parts  list  Is  the  following; 

Delay  (beyond  that  normally  and  routinely  experienced  in  the 
procurement  of  an  Item)  would  be  experienced  If  some  evi¬ 
dence  ol  the  ability  of  the  manufacturer  to  produce  the  item 
were  not  available  at  the  time  of  Issuance  of  the  purchase 
order. 

3.4  Significant  Factors. 

When  an  approved  source  of  supply  for  qualified  electronic  parts  list  is  based 
on  conformance  to  the  specific  requirements  stated  herein,  there  can  be  a  high 
degree  of  confidence  that  the  following  are  of  significance; 

(1)  That  the  manufacturer  mads  a  quantity  of  the  items  which  met  tho 
requirements  of  the  specification  at  one  time  and,  from  all  available  acceptance 
Inspection  records,  continues  to  do  so. 

(2)  That  the  manufacturer  possesses— or  has  the  us*  of— satisfactory 
test  equipment  for  all  tests  required  by  the  specification. 

(3)  That  the  manufacturer  maintains  satisfactory  In-plant  process 

control. 
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(4)  That  It  may  reasonably  be  assumed  that  a  manufacturer  so  listed 
will  be  able  to  deliver  Items  meeting  the  specification  requirements  !n  a  reasonable 
U  -.gth  of  lime. 


3.0  Basic  Requirements. 

(1)  The  entire  test  program  outlined  la  a  specification  shall  be  divided 
into  (a)  qualification  inspection  and  (d)  acceptance  Inspection.  TEeso  two  types  of 
Inspection  may  be  further  divided  Into  several  groups,  each  group  having  different 
sampling  rates  and  tests. 

(2)  'The  specification  shall  provide  for  separate  Identification  of  parts 
having  separate  levels  of  failure  rates  by  the  use  of  different  part  numbers.  The 
failure-rate  levels  used  shall  be  chosen  from  the  following: 

Failure  rate  per  1000  hours:  J%  (varying  with  the  Item) 

1.0* 

0.1% 

0.01% 

0.001% 

Mote:  The  failure-rats  level  specified  is  the  maximum  at 

the  90%  confidence  level  (10%  consumer  risk)  and  shall  be 

on  the  maximum  rated  use  condition. 

(3)  The  specification  shall  include  requirements  for  the  submission 
of  failure -rate  Information  to  the  approving  activity  and  for  In-pUnt  process  con¬ 
trol  and  adequate  facilities,  either  by  referencing  another  specification  or  by  In¬ 
cluding  the  details.  Initial  assurance  of  conformance  shall  be  provided  the  approving 
activity  by  the  manufacturer  concurrently  with  his  routine  reporting  of  acceptance 
inspection  results. 

(4)  Initial  qualification  approval  for  a  specific  failure-rate  level  shall 
be  given  when  failure -rate  Information  obtained  from  completed  qualification  Inspec¬ 
tion  testa  Justifies  that  specific  level  and  when  all  other  associated  specification 
requirements  have  been  met 

(6)  Continued  qualification  approval  for  a  specific  failure-rate  level, 
or  for  a  change  to  a  lower  or  to  a  higher  specific  failure-rate  level,  shall  be  based 
upon  failure-rate  Information  obtained  from  acceptance  Inspection  testa  and  upon 
conformance  with  all  other  associated  specification  requirements. 

(0)  The  specification  must  contain  ins  tractions  on  how  a  manufacturer 
receives*  his  very  first  listing  whan  be  has  no  order  or  contract.  It  is  suggested 
that  he  give  notice  to  whoever  controls  the  specification  that  he  is  ready  to  start 
Initial  qualification  Inspection,  with  Inclusion  os  an  approved  sources  of  supply 
list  as  his  goal.  He  than  starts,  with  or  without  an  order. 

3.<J  Re-evaloatlon  Approval. 

The  qualification  approval  procedure  will  ensure  that  tha  manufacturer  and 
the  manufacturer's  product  will  be  continually  re-evaluated.  Consequently,  the 
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apeclflcatlon.miwt  Include  the  dotalla  of  tho  kind  and  number  of  failures  that  will 
result  In  removal  from  tho  approved  sourcns  of  supply  ll3t.  Ra-evaluation  will 
also  necess<*r7  when: 

(1)  The  manufacturer  has  modified  the  Item; 

(2)  The  manufacturer  has  Instituted  a  design  change  In  the  material 
used  or  In  Ms  processing; 

(3)  The  specification  requirements  for  the  Item  have  been  amended  or 
revised  sufficiently  to  affect  the  character  of  the  Item. 

3.7  Using  Design  Acthrltleg1  Lists  of  Standard  Parts  and  Approved  Sources. 

Most  using  design  activities  (equipment  contractors)  maintain  a  list  of  standard 
parts  and  approved  sources  for  their  own  use.  These  should  not  be  confused  with 
the  parts  approved  on  Military  Qualified  Products  Lists.  Where  a  using  design 
activity  will  agree  to  working  arrangements  under  specific  contracts  or  groups  of 
contracts  with  a  particular  contracting  activity,  it  la  possible  that  the  use  of  & 
specific  using  design  activity's  approved  sources  list  might  simplify  approval  pro* 
cedures  for  nonstandard  parts.  specific  contracts  or  groups  of  contracts.  In 
this  case,  should  recognize  the  existence  of  the  using  design  activity's  list  and 
should  define  when  and  how  It  can  be  used. 

3.8  Recommendations. 

It  Is  recommended  that: 

(1)  Department  of  Defense  Manual  M2 04,  Military  Qualified  Products 
List,  be  revised  as  required  to  establish  the  approved  sources  of  supply  list 

(2)  The  qualification  approval  procedure  described  before  be  applied 
to  all  specifications  for  electronic  parts. 

(S)  Approved  Sources  of.  Supply  for  Qualified  Electronic  Parts  lists  be 
made  readily  available  to  both  parts  users  and  parts  manufacturers. 

(4)  The  Armed  Services  Procurement  Regulations  (A3PR)  be  revised, 
as  ?T>nlicehi»,  to  be  consistent  with  the  preceding  recommendations. 


4.  Military  Inspection  Practices 

la  this  section  of  the  report,  the  subgroup  evaluates  current  Inspection  prac- 
tlcea  and  suggests  Improvements.  The  Inspection  function  la  ao  important  that  the 
beat  spaclfleatlon  la  meaningless  to  the  user  of  elactronlc  parts  unless  this  Is  rec¬ 
ognized  and  the  function  supported  to  ensure  that  specification  requirements  are 
fully  enforced. 

4. 1  Present  Inspection  Policies. 

The  Department  of  Defense's  quality-assurance  policy  is  to  pro  ide  govern¬ 
ment  source  Inspection  for  products  shipped  to  Defense  using  activities  and,  where 
necessary  for  government  Inspection  purposes,  for  those  parts  that  are  shipped  to 
an  equipment  manufacturer's  plant  for  Incorporation  Into  equipment  to  be  supplied 
on  a  government  contract.  38 
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In  keeping  with  the  general  government  Inspection  policy  (A3PR-14-001  and 
DOD  Instruction  No.  4165. 0)  "to  assure  the  most  economical  Inspection  of  subcon¬ 
tracted  supplies  consistent  with  nrote^Mnn  of  product  quality,"  A3PR-1 4-105  states 
that  the  primary  purpose  of  government  source  Inspection  la  to  assist  the  govern¬ 
ment  Inspector  at  the  equipment  manufacturer's  plant  In  determining  the  confor¬ 
mance  of  supplies  with  contract  requirements;  It  does  not  relieve  the  equipment 
contractor  of  any  of  his  responslbilltlss  under  the  contract. 

Where  government  Inspection  Is  currently  required,  DOD  Instruction  No. 

4165. 9  provides  uniform  Department  of  Defense  policies  and  procedures  for  procure¬ 
ment  Inspection  of  items  covered  by  military  specifications.  It  establishes  a  policy 
that  suppliers  to  the  government  shall  be  responsible  for  performing  the  examina¬ 
tions  and  tests  set  forth  In  the  specifications  to  substantial*  the  parts*  .onformance 
to  specification  requirements;  that  suppliers  have  adequate  test  facilities  or  make 
arrangements  for  the  use  of  suitable  test  equipment;  that  the  government  inspector 
make  optimum  use  of  the  contractor's  test  records;  and  that  the  government  inspec¬ 
tor  see  that  a  product  verification  Inspection  is  conducted  to  show  that  the  supplier's 
records  represent  the  true  quality  of  the  product. 

Section  V  of  the  Instruction  provides  that  the  extent  of  government  Inspection 
may  be  adjusted  to  reflect  a  number  of  factors,  Including  the  amount  and  technical 
specialties  of  available  government  Inspection  manpower,  the  quality  history  of  the 
product,  the  Item's  complexity,  etc.  To  further  ensure  the  most  economical  and 
effective  use  of  government  Inspection  efforts,  the  Instruction  establishes  a  policy 
that  government  inspection  at  subcontractors'  plants  is  required  only  when  such  In¬ 
spection  Is  necessary  to  assist  the  government  inspector  at  the  prime  contractor's 
plant  In  determining  whether  subcontracted  supplies  conform  to  contractual  require¬ 
ments. 

In  summary,  DOD  quality-assurance  policy  places  on  the  prime  contractor 
the  responsibility  for  ensuring  product  quality,  including  the  quality  of  any  part  pro¬ 
duced  by  a  subcontractor,  and  provides  for  government  inspection  at  subcontractors' 
plants  when  It  1*  necessary  to  "assure  the  most  economical  inspection  of  subcon¬ 
tracted  supplies  consistent  with  protection  of  product  quality. " 

4.2  Effectiveness  of  Current  Inspection  Practices. 

To  obtain  a  picture  of  current  inspection  practices,  this  subgroup  took  advan¬ 
tage  of  the  results  o t  a  questionnaire  circulated  by  Subgroup  ST-5  to  approximately 
SO  equipment  manufacturers.  To  obtain  more  Information,  Subgroup  ST-2  circulated 
special  questionnaire*  to  shout  25  equipment  manufacturers  and  20  parts  manufac¬ 
turers.  The  results  can  be  summarized  as  follows: 

Equipment  manufacturers  purchase  approximately  50  percent  of  the  electronic 
parts  used  to  military  specifications;  government  source  Inspection  Is  requested  on 
approximately  35  percent  of  all  parts  other  than  tube*  or  semiconductor  devices. 
(Government  source  inspection  is  mandatory  on  all  electron  tube*  and  semicon¬ 
ductor  devices  sold  to  military  specifications. ) 

Although  some  equipment  manufacturers  depend  on  government  source  Inspec¬ 
tion  as  a  "guarantse"  of  minimum  quality  level,  using  the  QPL  as  a  shopping  list, 
they  buy  from  the  lowest  bidder  and  conduct  little,  if  any,  Incoming  inspection. 

Other*  who  are  engaged  in  missile  work  or  have  equipment  contracts  specifying 
reliability  levels  require  thorough  incoming  inspection  on  all  tubes  and  parts  that 


have  had  government  source  inspection.  Coma  typical  replies,  representative  of 
tha  majority,  follow: 

Company  A— Government  source  inspection  . .  merely  keeps  the  parts 
vendor  alert  that  basic  quality  'assurance*  audit  continues  tc  be  made.  In  some 
cases  it  is  actually  detrimental  in  that  certain  vendors  claim  immunity  to  the  re¬ 
turn  of  defectives  that  we  find  in  the  received  lots,  on  the  basis  that  'Government 
Inspector  accepted  the  lot,  based  on  the  data  taken,  and  therefore  we  have  no  further 
responsibility. 

Company  B— "No  assurance  that  parts  are  in  compliance.  All  too  often 
most  vendors  have  only  part-time  government  inspection,  and,  therefore,  assur¬ 
ance  of  product  quality  is  not  possible. " 

Company  C— Government  source  inspection  . .  probably  helps  control 

general  Inspection  procedures  and  broad  conformance  to  specifications.  Does  not 
give  us  much  assurance  that  a  specific  part  meets  requirements  to  which  it  was 
ordered." 


Company  D — "Utility  [pH  government  source  inspection/  questionable — 
we  will  100%  or  sample  teat  all  items  received  even  though  items  have  been  govern¬ 
ment  source  inspected." 

Company  E — "For  the  most  part,  Source  Inspection  provides  Utils  or 
no  material  benefits  to  the  contractor.  It  does  not  relieve  him  of  any  responsibili¬ 
ties  for  the  quality  of  the  parts  or  afford  him  any  avenue  of  come  back  ca  the  vendor 
in  tha  event  of  malfunctions.  It  appears  primarily  a  routine  providing  a  paper  satis¬ 
faction  and  the  Intangible  benefits  of  a  surveillance  system.  The  occasional  re¬ 
ported  findings  of  an  inspector  at  source  regarding  Inadequacy  of  a  vendor's  test 
equipment  serves  a  useful  purpose  but  this  information  should  be  obtainable  by  a  far 
leas  costly  procedure." 

Company  F — "Reasonable  assurance  that  the  components  inspected  and 
shipped  meet  the  specified  requirements.  Limitation  of  effectiveness  Is  imposed 
by  the  Inspection  system  itself  and  the  technical  capability  of  the  monitoring 
personnel." 

Responses  from  parts  manufacturers  threw  light  on  several  different  facets 
of  the  problem:  They  thought  highly  of  the  average  government  inspector  and  indi¬ 
cated  that  ha  would  have  little,  if  any,  trouble  keeping  up  with  the  state  ct  the  art; 
that  the  quality  of  government  inspection  was  high  in  their  respective  plants;  and 
that  only  a  small  portion  of  military  specifications  contain  provisions  difficult  to 
Interpret.  (Tha  exception  was  tha  capacitor  specification,  and  almost  every  capac¬ 
itor  manufacturer  commented  on  the  difficulties  it  created  for  both  the  inspector 
and  the  company. )  An  almost  overwhelming  response  was  indicated  for  the  intro¬ 
duction  of  in-plant  qualification  approval  testing  under  the  supervision  of  the 
government  inspector. 

Some  typical  replies  from  parts  manufacturers  on  the  advantages  and  disad¬ 
vantages  of  government  source  inspection  are  interesting: 

Company  P— "Advantages  include  a  certain  amount  of  prestige  with 
some  customers,  especially  when  Qualification  Approval  leads  to  Inclusion  on 
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Qualified  Products  Ltota  and  when  purel7  military  types  or  products  can  be  pro¬ 
moted.  Source  Inspection  usually  means  moro  detailed  testing  and  inspection  on 
lot-by-lot  basis  rather  than  being  able  to  apply  usual  methods  and  procedures  of 
qualicy  control.  Thfs  la  a  disadvantage  and  government  source  Inspection  does  not 
eliminate  customer  complaints  by  any  means.  Many  customers  also  perform  a 
receiving  inspection,  and  questions  of  correlation  of  test  data  arise  too  often." 

Company  Q— "A  peed  government  source  Inspection  tends  to  raise  the 
level  of  quality  of  product  Company  Inspectors  and  production  people  are  more 
careful  due  to  the  fact  that  they  see  a  government  inspector  cn  the  premises." 

Company  R~ Government  source  inspection  ". . .  decreases  customer 
necessity  for  extensive  testing;  insures  government  agencies  of  quality  level  on 
direct  purchases  where  their  facilities  do  not  permit  testing.  Wo  are  agreeable  to 
furnishing  Government  inspector  information  that  will  not  be  made  available  to  a 
civilian  customer." 

Company  S— "The  government  would  be  farther  ahead  by  employing 
fewer,  more  intelligent  and  better  educated  inspectors. 

"The  implication  of  quality  by  Government  'acceptance'  of  a  military  product 
is  misleading  particularly  if  a  sampling  plan  is  used.  The  practice  of  shipping 
'accepted'  lots  to  military  customers  and  rejected  lots  to  civilian  customers  to  also 
misleading  since  the  basic  production  quality  to  inherent  In  both  cases  because  the 
probability  of  defectives  to  essentially  the  same.  Hie  only  Job  of  government  in¬ 
spection  should  be  tho  assurance  that  the  manufacturer  utilizes  good  quality  control 
procedures,  has  qualification  approval  for  the  product,  and  to  manufacturing  the 
product  to  a  military  specification.  Acceptance  of  the  product  should  be  the  re¬ 
sponsibility  o£  the  customer. 

"With  regard  to  'in-plant'  qualification  approval,  there  to  no  doubt  that  the 
procedure  ..-m  be  speeded  up  by  toe  use  of  the  manufacturer's  facilities,  but  toe  tea' 
ahou.’d  >*■  ".ipervteed  by  a  government  laboratory— not  toe  local  inspector." 

4. 3  Recommendations. 


(1)  The  prime  responsibility  for  acceptance  or  rejection  ef  electronic  parts 
under  an  equipment  contract  should  remain  with  the  equipment  manufacturer. 

(?.)  Full  support  should  be  given  to  a  well-organized  training  program  for 
government  inspectors  in  which  Inspectors  would  receive  technical  and  statistical 
training  commensurate  with  proper  understanding  of  the  device  that  they  are  inspect' 
leg  and  toe  sampling  plans  be'ng  used. 

(3)  Government  inspectors  should  be  encouraged  to  assist  parts  suppliers  In 
obtaining  expeditious  resolution  of  problems  relating  to  the  Interpretation  of  speci¬ 
fications.  Inspectors  and  parts  manufacturers  should  report  problems  of  specifica¬ 
tion  interpretation  to  the  agency  that  prepared  the  specification.  This  feedback  will 
Initiate  the  anproprlate  changes  In  the  specifications. 
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S.  Acceptance  hegsctton 

Four  major  areas  requiring  attention  are:  (1)  provision  of  adequate  quality 
assurance  in  small  lots  of  expensive  items,  (2)  early  standardization  of  a  method  to 
handle  the  consumer's  risk  problem,  (3)  improvement  of  quality-assurance  require¬ 
ments  In  specifications  and  (4)  extensive  use  of  certified  test  data. 

5.1  Quality  Assurance  in  Small  Lots  of  Expensive  Items. 

Zlectronlc-system  reliability  Is  usually  influenced  by  a  few  expensive  items, 
for  example,  gyros  or  magnetrons.  For  this  kind  of  item,  specification  of  quality 
assurance  becomes  difficult  because  of  the  expense  of  the  required  tests.  It  has 
often  been  shown  that  this  cost  in  many  cases  can  be  a  minor  item  compared  to  the 
cost  of  system  unreliability  in  the  field.  Consequently,  statistical  techniques  (such 
as  chain  sampling  and  sequential  sampling)  and  contractual  guarantees  should  be 
thoroughly  investigated  with  a  view  to  optimizing  reliability  assurance  for  each 
situation. 

6.2  The  90 -percent  Confidence  Level  in  Sampling  Flans. 

Sampling  plans  are  used  as  a  means  of  deciding  whether  to  accept  a  lot  of  Items 
when  only  a  sample  of  the  lot  has  been  examined,  thereby  obviating  the  necessity 
of  testing  each  Item  in  the  lot.  As  currently  employed,  the  sampling  plans  in 
Standard  MIL-STD-1G6  indexed  by  AQLs  permit  very  wide  variation  In  the  discrimi¬ 
nation  between  "good"  and  "bad"  lots  at  the  80-percent  level  of  confidence  (consum¬ 
er's  risk  -  10  percent)  for  different  lot  sizes.  Because  of  this,  buyers  generally 
prefer  a  s t  -filing  plan  that  will  guarantee  a  stated  maximum  percent  of  defective 
items  for  :>ot  quality,  whether  100  or  10,000  items  make  up  a  lot.  Specification  of 
quality  In  terms  of  percent  detective  or  in  terms  of  failure  rate  at  the  80-percent 
level  of  confidence,  however,  assures  the  buyer  a  more  meaningful  guarantee  by  a 
gives  sampling  plan,  even  though  the  AQL  may  be  more  typical  of  the  actual  quality 
of  the  product. 

The  Electron  Tube  Panel  of  the  Aerospace  Industries  Association,  which  has 
been  concerned  with  this  problem  fcr  some  time,  has  suggested  with  the  Electronics 
Tniua  tries  Association  that  a  standardized  approach  be  adopted  to  present  the  needed 
information  for  the  use  of  specification  writers.  Accordingly,  the  Office  of  the 
Secretary  of  Defense  and  the  three  Military  Departments  are  working  on  a  project 
to  provide  this  information  in  the  next  revision  of  Standard  MIL -STD-106,  which  is 
expected  in  June  1960. 


6.3  Improved  Quality-Assurance  Requirements  in  Specifications. 

Inasmuch  as  the  majority  of  acceptance-inspection  problems  appear  to  stem 
from  inadequately  defined  specification  requirements,  the  DOD  program  now  being 
developed  should  be  supported  to  ensure  the1  Incorporation  of  unambiguous  and  prac¬ 
tical  quality-assurance  requirements  that  would  give  the  required  level®  of  reliability 
In  each  new  specification.  A  guide  tor  specification  writers  should  be  provided  that 
would  outline  procedures  for  achieving  these  ends. 
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5.4 


Certified  Tent  Data. 


Tfc»  ^  <*a rMf!®4.‘**24  Ic-  net  s  new  conccprr  the  subgroup  recommends  j 

that  the  wider  use  of  this  technique  would  be  useful  in  reducing  the  amount  of  testing  \ 

by  the  purchaser  of  electronic  parts.  i 

5.5  Recommendations. 

(1)  Statistical  techniques  (such  as  chain  sampling  and  sequential  sampling)  ! 

and  contractual  guarantees  should  be  thoroughly  investigated  with  a  view  to  their  use 

in  giving  greater  quality  assurance  in  military  specifications  for  small  lots  of  ex-  j 

pensive  items.  j 

(2)  The  90-percent  level  of  confidence  (consumer's  risk  *  10  percent)  should 
be  used  for  specifying  failure  rates  in  electronic  parts  specifications. 

(3)  The  DQD  program  for  ensuring  the  Incorporation  of  unambiguous  and 
practical  quality-assurance  requirements  that  would  give  the  required  levels  of  re¬ 
liability  in  new  specifications  should  be  supported.  In  this  program,  provision  shall 
be  mads  that  government  inspectors  conducting  audits  of  parts  manufacturers' 
facilities,  quality -control  programs  and  Sftt  checks  of  outgoing  product  quality 
should  determine  conformance  to  military  specification  requirements.  The  degree 
and  frequency  of  such  audlt3  and  checks  should  be  prescribed  in  the  individual  speci¬ 
fications. 

(4)  A  guide  or  manual  for  specification  writers,  outlining  appropriate  proce¬ 
dures  for  including  reliability-  and  quality-assurance  requirements  in  parts  specifi¬ 
cations,  should  be  developed  to  expedite  the  Implementation  of  the  over-all  program. 

(5)  Equipment  manufacturers  should  require  parts  manufacturers  to  supply 
certified  tent  data  with  each  shipment  as  objective  evidence  of  the  parts'  conform  anoe 
to  military  specifications.  Each  item  should  be  marked  or  suitably  identified,  pos¬ 
sibly  with  a  symbol  having  a  government  copyright,  indicating  that  the  parts  manu¬ 
facturer  has  qualification  approval  and  that  the  part  meets  a  military  specification. 

(8)  Equipment  manufacturers  should  mskt  maximum  use  of  certified  test 
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1.  Summary 

This  report  by  Subgroup  ST-3  contains  detailed  recommendations  and  sup¬ 
porting  data  for  (i)  the  collection  of  test  data  {including  failure-rate  data)  from  all 
Military  Service  contractors  and  subcontractors,  (2)  the  use  of  such  data  for  pre¬ 
paring  revised  and  new  military  specifications  and  (3)  the  establishment  of  a  pro¬ 
gram  to  obtain  and  publish  failure-rate  data  for  designers  of  electronic  equipment. 


Statement  of  Mission 

Subgroup  ST-3  was  assigned  the  task  of  studying  "methods  and  procedures  for 
the  adequate  collection  and  dissemination  of  technical  Information  on  both  parts  In 
use  and  new  Items." 


3.  Definitions 

For  the  purpose  of  this  report,  technical  Information  comprises  the  terms 
defined  as  follows: 

Application  data  for  parts  In  use  -  Those  technical  characteristics  that 
the  designer  should  consider  In  choosing  andapplying  the  part  In  his  design.  Some 
application  data  are  Included  in  Volume  H  (section  6)  of  this  report  and,  as  such, 
have  been  helpful  to  the  designer.  Other  characteristics  that  should  be  considered 
as  application  data  (or  use-limitation  data)  are  derived  from  the  requirements  In 
the  related  specification. 

Basic  fMlure  rate  -  That  failure  rate  established  as  a  requirement  for 
acceptance,  as  contained  in  parts  specifications,  and  determined  from  the  tests 
required  in  the  specification  and  as  a  function  of  the  conditions  required  by  such 
tests. 


Predicted  or  application  failure  rate  -  The  basic  failure  rate  modified 
by  the  conditions1  of  circuit  and  environmental  stress,  to  the  extent  that  these 
stresses  differ  from  those  established  for  determining  the  basic  failure  rate.  (It 
Is  Intended  that  the  predicted  failure  rate  for  parts  will  be  the  failure  rats  used  In 
the  computation  of  equipment  or  system  failure  rates. ) 

Observed  failure  rates  (defined)  -  Those  failure  rates  calculated  from 
equipment  or  system  failures,  for  example,  in  demonstrations  of  mean  time  be¬ 
tween  failures  of  equipment  or  systems. 
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Technical  lnforattion  on  now  items  -  This  doe*  not  differ  In  principle 
from  the  foregoing  except  that  (1)  the  mans  of  available  date  may  be  significantly 
less  ovine  to  Umlted.experience  with  the  Item  sad  (2)  such  items  are  defined  gen¬ 
erally  by  other  than  military  specifications,  l.e.,  users'  and/or  manufacturers' 
drawings  or  specifications.  The  technical  information  for  new  items,  therefore, 
must  include  the  defining  document  (users'  and/or  manufacturers'  drawings  or 
specifications)  but  is  not  limited  to  such  documents. 


4.  Sources  and  gourcs  Listings  of  Technical  Information 
4.1  Military  Field  Failure  Data. 

The  Intended  purpose  of  Department  of  Defense  Instruction  No.  3232.2, 
"Electronic  Equipment  Failure  Data  Reporting  System  and  DD  Forms  787  and  787-1/ 
dated  23  February  1968,  as  stated  in  paragraph  IV,  is  to: 

A.  Identify  high -failure  rate  parts  and  tubes  within  specific  equip¬ 
ments,  Including  determination  of  misapplication. 

B.  Avoid  the  use  of  Inferior  parts,  tubes  and  materials  in  vital  mili¬ 
tary  electronic  equipment 

C.  Identify  equipments,  circuits,  parts,  and  tubes  which  are  partic¬ 
ularly  reliable. 

D.  Predict  maintenance  requirements. 

The  instruction  further  state:  that: 

The  success  of  such  a  failure  reporting  system  In  reflecting  reli¬ 
ability,  performance,  and  maintainability  data  Is  dependent  on  the 
system  being  utilised  uniformly  to  report  all  failures  and  the  rapid 
transmission  of  the  reported  failures  to  the  proper  corrective  action 
agencies  within  each  Department  and  the  producers. 

Since  this  report  concerns  only  the  reliability  of  electronic  parts,  only  that 
aspect  of  the  aforementioned  Instruction  will  be  discussed. 

An  examination  of  various  studies  and  critiques  of  this  Department  of  Defense 
reporting  system  disc  Los  os  the  following  facts: 

(1)  Widely  varying  ratios  of  parts  failures  to  parts  Issued  (or  re¬ 
placed?)  have  been  experienced— 16  to  62  percent.  %  ® 


4nEat»  CoEoctioo  and  Evaluation, "  by  Donald  W.  Sharp,  Arlnc  Research 
Corporation,  Proceedings  at  the  Fifth  National  Symposium  on  Reliability  and 
Quality  Control  In  Electronics.  January  l9&>. 


(2)  It  is  not  evident  that  the  failures  reported  are  a  representative 
sample  of  the  total  failures. 

(3)  The  "hours  In  service"  Information  Is  usually  missing.  ® 

(4)  A  distinction  may  not  be  made  between  primary  and  secondary 

failures. 

(5)  Only  by  scientific  (or  engineering)  analysis  of  equipment  failures 
by  expert  technicians  can  the  field  reliability  failure  rates  be  determined. 

(6)  A  certain  few  of  the  supplementary  codes  identified  "types  of 
failure"  are  not  types  of  failure  but  are  In  reality  "causes  of  failure.  ” 

It  Is  presumed  that: 

(1)  The  supply  activities  of  the  Military  Service  may  be  able  to  use 
the  analysis  of  data  from  their  reporting  systems  to  predict  maintenance  require¬ 
ments. 

(2)  Certain  problem  areas  may  become  evident  on  the  basis  of  relative 
failure  occurrence. 

However,  It  mast  be  concluded  that  field  reliability  failure  rates  cannot  be  obtained 
by  analysis  of  these  data,  since: 

(1)  Not  all  failures  are  reported; 

(2)  The  failures  reported  may  not  be  properly  Identified  as  primary; 

(3)  "Operating  time*  may  be  missing  or  Insufficiently  accurate; 

(4)  Misapplications  cannot  be  properly  identified; 

(6)  Operating  time  of  units  that  have  not  failed  is  not  provided. 

4.2  Monthly  Catalog  of  United  States  Government  Publications. 

This  catalog7  lists  documents  printed  by  or  for  the  U.S.  Government  Printing 
Office.  Also  listed  are  "processed"  documents  (1.  e. ,  publications  reproduced  by 
duplicating  processes  other  than  ordinary  printing,  e.  g. ,  mimeograph,  multigraph, 
planograph,  rotaprint,  multlllth),  but  these  publications  cannot  be  secured  from  the 
Superintendent  of  Documents  and  requests  should  be  addressed  to  the  issuing  office 
Identified  In  the  catalog. 

Under  the  provisions  of  the  Printing  Act  of  January  12,  1885,  all  government 
publications  are  entored  In  the  Monthly  Catalog;  administrative  and  confidential  (or 
restricted)  publications,  however,  are  omitted. 

Aibllcattona  are  grouped  by  the  preparing  or  responsible  bureau,  service  or 
agency. 

®See  Footnote  4. 

7 For  sale  by  the  Superintendent  of  Documents,  U.  S.  Government  Printing 
Office,  Washington  25,  D.  C. ,  $0. 25  per  copy ;  subscription  price  per  year,  $3 
(Including  Index). 


Documonta  o f  particular  Interest  within  the  framework  of  this  study  are  nor¬ 
mally  of  the  "processed"  type,  and  where  Indicated  are  'or  sale  by  the  Office  of 
Technical  Services  (OTS),  Department  of  Commerce-  Some,  publications- ar*  ■ 
further  Identifier  by  A3TIA  (Armed  Services  Technical  Information  Agency)  AD 
numbers.  (ASTIA  services  are  described  In  section  4. 3  of  this  subgroup  report. ) 

Publications  relevant  to  this  study  are  listed  under  the  following  headings  and 
subheadings: 


Air  Force  Department 

Air  Force  dam  bridge  Research  Center  (AFCRC) 
technical  note  (TN)  series 
technical  report  (TR)  series 
Rome  Air  Development  Center  (RADC) 
technical  note  (TN)  series 
Wright  Air  Development  Center  (WADC) 
technical  note  ( TN)  aeries 
technical  report  (TR)  series 

Army  Department  (publications) 

Defense  Denartxaent 

MifliiuyhanJbook  (UTL-HDBK)  series 
(Office  of  the  Assistant  Secretary  of  Defense  (Supply  and 
Logistics)) 

IfUliary  standards  (MIL -STD)  series 
Standardisation  manuals  (M)  series 


eat 


Navy 

Ships  Bureau 

Aeronautics  Pnrean,  Navy 
NAVAXR  900, 000  aeries  (publications) 


4.3  Armed  Services  Technical  Information  Agency. 

ASTIA  mi  established  to  provide  technical-information  services  for 
Department  of  Defease  agencies  sad  their  contractors. 


All  DOD-eponaorwd  scientific  sad  technical  reports  are  cataloged,  nearly 
200, 000  reports  being  identified  by  subject  and  source.  Searches  may  be  made  of 
single  or  multiple  subjects  (UNOTRM3). 


Twice  monthly  ASTIA  publishes  a  Technical  Abstract  Bulletin  whose  distribu¬ 
tion  la  United  to  Department  of  Defense agencies  and  others  engaged  in  the  military 
research  program.  Xntrles  refer  to  both  classified  and  unclassified  reporta  re¬ 
ceived  by  ASTIA,  hut  classified  titles  end  abstracts  are  omitted  to  keep  the  Bulletin 
unclassified. 


A  representative  Issue  of  the  Bulletin  (1  April  1968)  lists  approximately 
1000  reports,  categorised  la  33  major  subject  divisions.  Two  major  subject  divi¬ 
sions  (Division  7  *  Electrical  equipment  and  Division  9  -  electronics  and  Electronic 
equipment)  contain  reports  on  electronic  parts.  In  the  issue  examined  21  titles 


land  abatracto— • unclsaalflod)  of  poosiblo  interest  out  of  90  listings  »er*  Jq ontifled. 
The  timelinoss  of  all  90  reports  In  these  two  major  subject  divisions  was  examined 
with  the  following-  results? 
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Percentage  of  reports 

Interval  between  report 
publication  (tote  and  date 
of  Bulletin  {ia  months) 

m 

More  than  4 

m 

More  than  8 

62% 

Mora  than  9 

Of  the  21  titles  of  possible  interest,  only  2  reports  contained  evaluation  data  which 
either  include  failure  rates  or  from  which  failure  rates  may  be  calculated.  The 
remaining- 10  titles  of  possible  iatareat  cover  research  data  or  data  relative  to  new 
product  developments,  bit  no  failure-rsto  data  per  as  appear  to  be  Included. 

•£. ,!l  Sa  3.  Government  Research  Reports. 

Tlw  following  is  quoted  from  the  monthly  publication  IF.  8.  Government  Re- 
KCflfclt  Reparla^:  '  ""  "*  "  "  “  " 

Tfc»  FB  Reports  , . .  snaou,nc*d  in  this  publication  have  Just  been  re¬ 
leased,  usually  by  ageawd*s  of  the  U.  S.  Government,  for  dissemina¬ 
tion  to  tfcn  public.  In  most  Instances  they  result  from  Government  or 
Go'swrcma  at-apofcsorad  resoaoreh. 

Tfca  Office  sf  Technical  8errvlc*3  la  responsible,  under  Public  Law 
flYSj  8i»1  Coagrsas,  for  the  collection  and  diatrtbiattoa  of  these  tech¬ 
nical  reports  in  tea  Interest  cf  American  science  and  industry. 

The  more  Important  reports  are  reprinted  fox'  sale  to  the  public  by 
OT3.  Many  of  the  reports  are  so  specialized  that  the  demand  for 
them  does  not  warrant  reproduction  of  printed  copies;  originals  of 
these  documents  are  deposited  at  the  Library  of  Congress.  There 
they  may  be  Inspected  in  the  Annex  Reading  Room,  or  copies  may  be 
ordered  from  the  Library  la  either  photocopy  or  microfilm. 

PB  reports  of  special  interest  to  smaller  business  are  abstracted  in 
OTS's  monthly  Technical  Reports  Newsletter,  available  from  the 
Superintendent  at  Documents,  Washington  26,  D.  C.,  at  $1  a  year 
domestic,  %l.  60  foreign. 


8  Annual  subscription  $6  {($3  additional  for  foreign  mailing);  single  copy,  |0, 80. 
In  the  United  Statue,  make  remittance  payable  to  the  Superintendent  of  Documents, 
*xA  mail  either  to  a  {Department  of  Commerce  field  office  or  to  the  Superintendent 
of-  Document*,  U.  S.  Government  Printing  Office,  Washington  38,  D.  C.  Address 
chargee  abould’b*  sent  to  the  Superintendent  of  Document).  Outside  the  United 
Plates,  make  remittance  payable  to,  and  order  from,  the  Office  of  Technical 
Services,  U.  S.  Department  of  Commerce,  Washington  2C,  D.  C.  Foreign  address 
{change*  should  b*  sent  to  the  OTB. ) 
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Since  1MB  thousands  of  buslnsss  fines  haw  ussd  PB  report*  la  thair 
rssaarch  programs.  Thee*  reports  now  eonatttuts  oas  of  the  world's 
largest  collections  o.vnon-confldentiil  technical  Information,  cumber- 
log  over  260, 000  Items.  OiS  has  published  catalogs  of  related  re¬ 
ports  la  more  than  900  areas  of  Industrial  Interest.  For  further  In¬ 
formation  relative  to  ary  of  Its  activities,  you  are  Invited  to  write 
OTS,  TJ.  S.  Departmoafc  of  Commerce,  Washington  20,  D.  C. 


f  ^ 


}  L 


i 


Except  to  the  extent  indicated  by  acknowledgment  of  authorship,  018 
does  not  edit  PB  reports,  nor  does  It  accept  responsibility  for  the  In¬ 
formation  and  conclusions  contained  In  them.  12  copyrighted  material 

appears,  permission  for  Its  us#  should  b#  requested  from  the  copy-  j 

right  owners.  Any  national  security  restrictions  they  may  have  ap¬ 
plied  to  these  reports  have  been  removed.  Patents  may  cover  the  sub-  \ 

Ject  matter  of  any  reports,  and  the  reader  Is  advised  to  make  patent  . \ 

searches  before  developing  applications  based  on  tbs  reports. 

•  | 

A  representative  issue  of  the  U.  8.  Government  Research  Reports  (16  Hay 
1969)  lists  approximately  560  reports,  categorised  In  96  major  subject  division* 
and  subdMstone.  Major  subject  division  "Engineering*  and  subdivision  "Electrical 
and  Electronic  Engineering"  list  reports  of  interest;  In  the  issue  examined,  27 

tides  (and  abstracts)  of  possible  interest  out  of  69  listings  in  the  subject  subdivision.  I 

were  Identified.  The  timeliness  of  all  69  listings  was  examined  with  the  following 

results:  !  1 

I'  ■ 

Interval  between  report  [ 

publication  date  and  date 

of  Research  Reports  , 

Percentage  of  reports  (in  months) 

100%  More  Own  7  i 

81%  More  than  12 

49%  More  than  21 


Of  the  7  reports  carrying  a  data  7  months  before  that  of  the  Research  Reports  Issue, 
6  ere  also  Identified  by  ASTXA  AO  number*  and  are  therefore  listed  by  A3TIA. 
Further,  of  the  69  11s tings,  37  r  re  also  Identified  by  ASTIA  AO  numbers,  end  of  the 
27  reports  of  Interest,  17  are  also  Identified  by  ASTIA  AO  numbers. 


From  this  It  would  appear  that  the  listings  In  the  ASTIA  Bulletin  are  signifi¬ 
cantly  more  timely  then  the  ilsUngi  In  the  P.  3.  Government  Research  Reports. 

Of  the  27  titles  of  possible  Interest,  only  4  reports  contained  evaluation  date 
which  either  Include  failure  rates  or  from  which  failure  rates  may  be  calculated. 
The  remaining  23  titles  of  possible,  interest  cover  research  data  or  data  relative  to 
new  product  developments,  but  no  failure-rate  data  per  se  appear  to  be  Included. 
There  seems  to  be  no  comprehensive  organised  military  program  for  electronic- 
parts  evaluation  Intended  to  obtain  failure  ratee  as  a  function  of  circuit  &nd  environ¬ 
mental  stress. 

4,5  Advisory  Orcupe  on  Electronic  Parts  (AOEP)  and  Electron  Tube*  (AOET). 

These  two  groups  are  activities  of  the  Office  of  the  Director  of  Defense  Re¬ 
search  and  Engl  peering  (ODDRfcE),  Office  of  the  Secretary  of  Defense  (OSD),  and 
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execute  their  function*  under  th«  supervision,  administration  and  control  of  th* 
Director  of  Electronic*,  ODDR&E. 

7b*  membership  of  AOEP  and  AOET  Is  composed  of  civilian,  consultants  to 
OSD  and  representative*  of  the  Milltarr  Departments  and  other  agencies  of  the 
Federal  Government. 

The  method  of  operation  used  by  AOEP  and  AGET  and  their  respective  working 
groups  la  such  as  to  ensure  that  all  phases  of  military  research  and  development 
(Including  test  and  evaluation,  Indus  trial  prepare doses  measures  and  production 
refinement)  within  their  specified  fields  of  In' treat  are  under  continuous  review, 
not  only  by  specialists  In  the  Military  Departments  but  also  by  th*  const-"  mts,  who 
are  expert  scientists  and  onglneers  from  Industry  acting  Is  the  public  Interest. 

In  order  to  carry  on  this  activity  effectively,  the  advisory  groups  must  have 
current  Information  on  all  government-sponsored  work  within  their  fields  of  Interest 
The  Information  la  derived  from  contract  reports,  supplemented  by  periodic  visits 
of  members  of  the  technical  staffs  of  th*  secretariats  to  contractors’  plants  for 
first-hand  discussions.  These  visits  frequently  elicit  information  on  company- 
sponsored  work,  and  occasionally  uncoordinated  developments  being  supported  under 
"black-box"  subcontracts  are  unearthed.  Additional  Information  is  obtained  from 
presentations  at  working-group  meetings  by  contractor  employees  or  representa¬ 
tives  of  government  agencies.  Information  on  foreign  work  is  obtained  from  foreign 
technical  publications,  Intelligence  reports  and  presentations  by  individuals  who 
have  recently  visited  abroad  and  through  mutual  exchange  agreements  with  certain 
countries. 

Some  AOEP  publications  are  as  follows: 

3.2  73m  Advisory  Group  on  Electronic  Parts  Annual  Report  for  the 
year  1967,  GEP  107/3  classified  CONFIDENTIAL,  was  prepared  at 
the  Secretariat  and  approximately  two  thousand  copies  were  distributed 
to  personnel  of  AOEP  and  to  a  selected  list  of  individuals,  educational 
lnsfituttosa,  government  contractors,  and  members  of  the  electronics 
industry. 

3. 3  to  December  of  1968  two  thousand  coplea  of  a  document  entitled 
"Capsule  Nummary  of  the  AGXP  Program  la  the  Area  of  Electronic 
Puls  Materials,"  GEP  246/1,  were  mads  ready  tor  distribution  from 
the  AGEP  Secretariat,  early  la  January,  1969.  Printed  directly  from 
punched  cards,  this  doctuaeai  made  possible  the  dissemination  o i 
Information  concerning  active  and  completed  projects  in  th*  AGEP 
program  la  a  manner  which  Insured  that  th*  information  was  less 
Umii  a  month  old  at  the  time  of  distribution.  It  Is  planned  to  keep  th* 
cards  in  a  state  of  constant  revision  and  to  iaaue  subsequent  editions 
of  ' the  Capsule  Nummary  at  approximately  ant-month  Intervals.  . . . 

7b  provide  a  means  for  disseminating  Information  in  the  area  of  elec¬ 
tronic  parts  and  materials  which  does  not  have  'Its  origin  In  a 
government-sponsored  contract  reported  to  tide  group,  Information 
bulletins  and  resumes  are  used.  Varying  widely  In  subject  matter 
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ihm*  notice*  provide  a  medium  for  the  rapid  dissemination  of  Infor¬ 
mation  In  the  possession  of  the  Secretariat.  In  18C8,  S3  of  those 
bulletins  were  prepared  and  distributed.9 

An  Information  service,  based  on  an  Information  file  of  about  25, 000  cards 
containing  data  in  the  area  of  electronic  parts  and  materials,  Is  now  available  for 
AGEP,  the  government  and  contractors  who  have  a  need  to  know. 

Data  is  stored  cn  cards  by  means  of  a  code  developed  by  Secretariat 
personnel.  Information  Is  constantly  being  revised,  updated,  and 
expanded,  and  every  effort  is  made  to  keep  tbs  data  aa  up  to  data  as 
possible,  but  It  must  be  emphasized  that  the  system  does  not  seek 
out  Information— It  merely  stores  lti  Good  reporting  is  therefore  a 
requirement  if  the  system  is  to  be  fully  effective.  10 

Visibility  to  AGEP  and  AGET  regarding  the  development  of  now  Items  Is  not 
complete  and  Is  related  to  the  manner  In  which  new  Items  come  Into  existence. 

Three  categories  of  such  Items  can  be  Identified: 

(1)  Items  developed  by  the  Military  Departments,  directly  funded  by 
Identifiable  military  contracts.  The  screening  and  surveillance  activities  of  AGEP 
and  AGET  provide  significant  visibility  In  this  category. 

(2)  Herns  developed  by  or  lor  a  prime  equipment  contractor  (to  the 
Military  Departments)  or  a  subcontractor.  Indirectly  funded  by  military  contract. 
Many  factors  contribute  to  the  lack  of  visibility  for  Items  In  this  category.  Dif¬ 
ferences  In  reporting  methods  and  work  load,  by  contractors,  subcontractors  and 
the  military  equipment-procuring  activities  are  among  the  considerations  Involved.  " 

(3)  Hems  developed  by  component  suppliers,  using  their  own  hinds, 
either  to  meet  a  need  expressed  by  an  equipment  manufacturer  (prime  or  subcon¬ 
tractor)  or  to  meet  a  need  as  determined  by  the  supplier  based  on  his  own  market 
research. 

AGEP  and  AGET  have  been  aware  of  the  situation  with  respect  to  both  cate¬ 
gories  (2)  and  (3)  and  are  trying  to  increase  their  visibility  of  such  Items,  as  Indi¬ 
cated  by  the  following  paragraph,  which  appeared  In  brochures  of  the  two  advisory 
groups  published  several  years  ago: 

An  earnest  Invitation  Is  extended  to  Industry  to  register  with  the 
AGEP  and  AGET  Secretariats  those  projects  In  the  area  of  elec¬ 
tronic  parts  and  electron  tubes  respectively  which  are  under  way  and 
which  are  sponsored  by  private  funds.  Such  work  may  be  reported 
In  as  much  detail  aa  desired,  and  with  or  without  permission  to  dis¬ 
close  Information  beyond  the  acknowledgment  that  such  work  Is  in 
progress,  Da  other  words,  aa  Industrial  development  may  be  listed 
with  the  understanding  that  inquiries  at  the  Secretariats  will  be 
turned  over  to  the  company,  or  that  no  Information  whatsoever  will 
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be  given  out  by  the  Secretariats.  The  mere  fact  that  u  place  is  now 
available  where  such  Information  may  bo  obtained  can,  when  It  is 
functioning  full*  countless  man  hours  and  funds  through 
elimination  of  parallel  effort.  This  point  alone  should  provide 
justification  for  whole-hearted  participation  in  tlds  effort  by  all 
phases  of  the  electronics  Industry. 

4.8  Recommendations. 

(1)  New  and  controlled  programs,  manned  by  expert  technicians  whose 
sole  responsibility  Is  to  obtain  and  analyze  failure-rate  data,  should  be  established 
to  obtain  observed  failure  rates  for  typical  air,  shipboard  and  ground  applications. 

(2)  The  observed  failure  rates  obtained  from  the  programs  recom¬ 
mended  In  (1)  should  be  compared  with  failure  rates  obtained  from  an  Improved 
Electronic  Equipment  Field  Data  Reporting  System  to  determine  whether  a  correla¬ 
tion  exists. 

(3)  The  Electronic  Equipment  Field  Data  Reporting  System  should  be 

Improved  to 

(a)  Increase  the  ratio  of  reported  failures  to  total  failures; 

(b)  provide  for  better  analytical  recognition  of  primary  failures; 

(c)  provide  for  analytical  criteria  of  misapplications; 

(d)  malm  mandatory  the  recording  of  elapsed-time  readings  and 

(e)  include  operating  time  on  units  not  failing. 

(4)  The  Military  Services  should  establish  as  standard  that  military 
equipment  Incorporate  elapeed-tlme  indicators  where  feasible. 

(6)  The  Military  Services  should  standardize  one  elapaed-time  Indi¬ 
cator  for  use  In  electronic  equipment  to  provide  time-to-failure  data  for  controlled 
Investigations  (see  recommendation  (1))  and  for  the  Electronic  Equipment  Field 
Data  Reporting  System. 

(6)  A  special  bibliography  of  reports  should  be  prepared  and  main¬ 
tained  in  a  state  of  constant  revision  to  provide  visibility  of  Investigative  efforts  on 
electronic  parts  on  a  current  basis.  Such  a  bibliography  must  be  published  at  Inter¬ 
vals  and  with  significantly  greater  timeliness  than  the  listings  In  the  foregoing 
sections  4. 3,  4. 4  and  4,  6.  This  bibliography  should  be  published  In  the  form  of  a 
Department  of  Defense  handbook  In  the  MH.-HDBK  series.  Visibility  regarding  the 
existence  of  such  a  handbook  would  therefore  be  obtained  by  Its  listing  In  the  mili¬ 
tary  indexes  of  specifications  and  related  documents. 

(7)  Wide  publicity  should  be  given  to  the  Advisory  Group  on  Electronic  . 
Parts  and  Us  "program"  of  dissemination  of  Information  (in  particular,  in  the  area 
of  electronic  parts  and  materials)  that  does  not  originate  In  a  government-sponsored 
contract. 


(8)  The  Military  Services  should  establish  a  more  comprehensive  pro¬ 
gram  to  evaluate  electronic  parts  to  obtain  failure-rate  data  a a  a  function  of  circuit 
and  environmental  stress, 
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S.  Technical-Data- Exchange!  Activities  la  Industry 
5.1  ICBM  (TITAN)  Program. 

(1)  Objectives; 

(a)  To  provide  ready  visibility  of  componenT  ‘eat  data  generated 
by  participating  contractors; 

(b)  To  s«t  op  a  mechanism  to  facilitate  the  Interchange  of  com¬ 
ponent  test  data  between  the  participants. 

(2)  Method: 

(a)  Components  and  parts  are  classified  under  82  categories  to 
permit  ready  Identification  and  listing. 

(b)  Knrironmental-test-lerei  codes  are  established  to  identify  the 
various  environmental  categories  and  associated  severity  levels. 

(3)  Operation: 

(a}  A  TITAN  Interchange  Data  List  Is  compiled,  listing  the  brief 
report  title,  classification  numbers  ss  appropriate  and  the  originator's  report 
number. 


(b)  The  aforementioned  list  is  circulated  by  a  control  office  to  the 
participating  contractors.  A  contractor  who  requires  a  particular  report  requests 
It  from  the  originator,  sending  a  copy  of  the  request  to  the  control  office. 

(c)  The  function  of  (be  control  office  Is  to  keep  the  Interchange 
Data  List  current  and  to  monitor  toe  exchange  operation. 

(4)  Results:  Since  the  Inception  of  the  program  about  a  year  ago,  each 
contractor  has  offered  about  100  reports  for  listing.  Approximately  80  reports  per 
month  are  requested  by  interacted  contractors  from  those  listed. 

6.8  Program  of  the  Naval  Orthsacs  Laboratory.  Corona  (NOLC). 

(1)  Objectives;  To  provide  reliability  guidance  In  the  choice  of  com¬ 
ponents  to  be  used  In  a  missile  by  several  contractors. 

00  Matbod:  The  various  missile  contractors  furnish  NOLC  with  com- 
prehenelvw  engineering  teat  reports,  which  Include  qualification  and  receiving  in¬ 
spection  testa.  Environmental  and  functional  requirements  surrounding  the  usage 
of  the  part  are  included  la  the  testa.  These  data  are  analysed  to  determine  the 
suitability  of  toe  part  tor  toe  application.  A  further  analysis  Indicates  the  beet 
vendor,  or  vendors,  from  whom  tos  part  should  be  obtained. 

(I)  Operation:  Based  oa  the  raw  data  received,  NOLC  prepares  a 
summary  report  containing  abstracts  of  sach  tost  and  recommendations  for  future 
gsldancs  of  toe  m  toe  lie  manufacturers.  The  reports  are  made  available  to  govern¬ 
ment  agencies  sad  appropriate  missile  manufacturers. 
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5. 3  QA-1  Program  of  the  Electronic  Industrie*  Ansoclatlon  (E1A). 


(1)  Object! vo :  To  provide  a  mechanism  whereby  participating  firms 
are  ratified  that  parts  have.  ~ucc«iafuUy  met  qualification  requirements. 

(2)  Method:  Participants  will  submit  data  on  standardized  preprinted 
forms  to  the  EIA  Exchange  Headquarters.  The  form  will  include  the  following  In¬ 
formation: 


(a)  Name  and  address  of  testing  company  and  division 

(b)  Part  name 

(c)  Date  of  test 

(d)  Part  classes  (This  Involves  the  use  of  a  6 -digit  classification 
code.) 

(a)  Vendor  drawing  number  or  military  nomenclature  describing 
component  under  test 

(f)  Vendor  identification  by  name  and  address  and  division 

(g)  Environmental  test  information  described  by  a  classification 
of  21  different  categories  of  environment 

(h)  The  specification  that  is  being  used  to  test  the  component 

Only  parts  that  are  approved  for  use  by  the  reporting  company  are  eligible  to  be 
reported  In  this  program. 

(3)  Operation:  The  data  filed  under  this  program  would  be  reduced  to 
punched-card  presentation  and  periodically  distributed  to  participants. 

(4)  Current  Status:  The  EIA  has  cfeci.ded  not  to  activate  this  program. 
5. 4  Battelle  Memorial  Institute  -  Electronic  Component  Reliability  Center. 

(1)  Objective:  To  provide  participating  firms  with  reliability  and  per¬ 
formance  data  on  electronic  components. 

(2)  Method: 

(a)  A  group  of  the  largest  users  of  electronic  component  parts 

would  be  formed. 

(b)  Battelle  would  serve  as  the  center  for  th's  nrouo. 

(c)  The  members  of  this  group  w  id  po-.A  tieir  component  per¬ 
formance  data  at  Battelle. 

(d)  Battelle  representatives  vjuld  visit,  the  participating  Cnr  ) 
to  aaaiat  in  tha  collection  of  the  data. 

(a)  The  data  would  be  cataloged  and  stored  In  an  "as  received1' 

form. 
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component  8aiilctail.t  been  collected  on  a  particular 

a  wc  “ e,ch  «**■ 

component  type  te  weST*  <“i*  °'  ’wHrl“°" “» 

•tylee,  stew  end  raa£*1X$b; ;“bra*““  ““  «  manutectnrors, 

pooled  dots;  and  W  ''PP'totl0“  WormaHon  resnlHnj  iron  the  analjaea  of  the 

Arm,  haw  JS&StBtfil  SSftgSZ 
®*  5  Other  Exchange  Programs. 

to  the  teeS^^d: here  *"  OT“Uer*b^  l8ss  <°™*  «»>  ««»•  Idendfled 
(1)  The  National  Aircraft  Standards  Committee  fNA'?r,l  nf  a„~, 

^  and  other  documents.  The  findings  of  such 
■trtSTliS^SaSS.^  Sad  o(  appro- 

davel°pment  of  standards,  committee  members,  as 
s^)iaors  of  standardization  projects,  conduct  tests  to  assure  themselves  th&t  the 
J5J21  "•  '«*  a*l  conforming  articles  exist  LSequenlto  Z 

a  Sat  ^fUfkrd'  commlttee  members  have  access  to  the  test  data  on  re¬ 
s'*?**  to  the  project  sponsor.  No  listings  of  projects  are  made  for  the  mimosa  of 
data  exchange.  Committee  working  agenda  and  Interim  prog ret  s  reports  team* 

ShtorfSl  i2S*nS.#?1C%te  Pr0Vtid8  Vl3lblUt7  of  wo*k  bproceJs.  Committee 
historical  records,  agenda  and  promulgated  standards  identify  project  sponsors. 
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(of  TgflrSBE  Industries aVs'ccuM,  revised 
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5. 9  Conclusion#. 


(1)  It  ha*.notheen..noMlhle  to-rf^h  any  «ra3nstoru?  regardi/ig"'cfca' ' 
worth  crf'lndustrtal  data-exchange  programs  since  no  Information  can  be  obtained 
on  their  resulting  influence  on  reduction  of  test  effort.  However,  it  is  relatively 
clear  that  test  effort  could  be  reduced  if  recipients  could  have  confidence  in  th» 
tests  performed  by  others. 

(2)  The  cost  of  data  exchange  is  not  exclusively  the  cost  of  preparing 
reports  for  exchange  purposes,  the  cost  of  distribution  and  the  cost  of  receipt  and 
record  keeping.  It  Is  believed  that  the  hidden  costs  can  more  than  exceed  the  ap¬ 
parent  costs.  These  hidden  costs  are  those  associated  with  the  time  that  may  be 
spent  by  the  engineers  In  reviewing  the  data  purporting  to  be  related  to  the  same 
part  but  which  are  different  owing  to  the  differences  In  statements  of  requirements, 
quantities  of  parts  to  be  tested,  environmental  levelr  and  test  methods. 

(3)  If  the  data  exchanged  are  used  for  comparison  purposes  (which  is 
believed  to  be  the  principal  purpose  of  data  so  exchanged),  this  comparison  Is  use¬ 
ful  and  valid  only  If  the  teat  methods  are  similar  enough  to  produce  the  same  results 
and  detailed  enough  to  allow  correlation  between  different  test  laboratories. 
Efficiency,  expediency  and  tradition  have  caused  a  degree  of  standardization  of 
tec't  methods  through  the  use  of  methods  set  forth  In  MIL -STD-202.  It  is  believed 
that  an  expansion  of  MIL -STD-202  In  scope  and  detail  would  serve  to  further 
standardize  test  methods. 

(4)  Whether  the  exchanger  of  data  Is  intended  by  the  participants  to 
(a)  reduce  test  effort  or  (b)  provide  for  comparison  of  experience,  no  Industry 
data  exchange  along  existing  linos  will  effectively  reduce  test  effort,  since  there  Is 
entirely  too  much  fear  of  legal  entanglements,  uncertainly  regarding  responsibility 
and  lack  of  confidence.  It  must  be  noted,  however,  as  an  exception  that  the  NASC 
program  mentioned  In  section  6. 6(1)  does  not  suffer  from  these  ills. 

6. 7  Recommendations. 

It  Is  recommended  that  the  Department  of  Defense  establish  a  central  organi¬ 
zation  for  the  collection  and  dissemination  of  technical  information  on  electronic 
parts  defined  by  existing  military  specifications.  Such  technical  information  should 
Include: 

(1)  Application  data 

(See  prototype  application  data  In  Volume  n,  section  4. ) 

(2)  Basic  failure  rates 

(3)  Predicted  and  application  failure  rates 

(See  section  3  for  definitions  of  these  terms. ) 


9.  Contractual  Data  Requirements 

In  the  examination  of  contractual  data  requirements,  this  part  of  the  study 
was  limited  to  requirements  for  the  appllcsble  data  as  contained  In  military 


specification*  and  further  exclusively  to  those  known  as  "General  Electronic  Equip¬ 
ment  Specifications"  ana  to  the  recent  specification  governing  the  requirements  for 
"Engineering  Drawings" 

0. 1  Nonstandard  Part  Approvals. 

The  electronic-equipment-procuring  activities  of  the  Military  Services 
generally  required  contractors  to  substantiate  their  need  for  nonstandard  parts. 

This  substantiation  is  Intended  to  Include  an  Identification  of  the  part  characteristics 
needed  for  the  application  and  a  comparison  of  these  needs  to  the  characteristics  of 
the  most  similar  standard  part.  Further,  under  certain  conditions,  test  data 
demonstrating  conformance  to  the  equipment  needs  are  required. 

The  data  requirements  of  some  electronic -equipment-procuring  activities 
dttier  slightly  in  detail,  but  the  intent  is  clearly  the  same;  the  data  are  designed  to 
serve  as  a  basis  for  determining  that  a  standard  part  cannot  be  used  and  that  the 
quality  of  the  nonstandard  part  chosen  by  the  contractor  Is  satisfactory  for  military 
equipment. 

Some  activities  require  copies  of  the  company  drawing  or  specification  used 
to  procure  the  part,  and  two  activities  require  that  the  part  characteristics  be  pre¬ 
pared  In  the  same  fora  as  the  military  specification  sheets — or  the  military  speci¬ 
fication  for  foe  most  similar  Item ,  Generally,  the  electronic-equipment  contractors 
have  established  foe  practice  of  defining  the  characteristics  of  nonstandard  ports 
by  means  of  company  drawings,  or  specifications  or  a  combination  of  both.  This 
primarily  results  from  a  desire  to  define  and  control  the  characteristics  cf  the  part 
for  procurement  and  receiving  inspection,  partly  to  assist  in  the  preparation  of 
Item  descriptions  for  stock  numbering  and  partly  to  meet  the  requirements  for  data 
on  nonstandard  parts. 

Company  drawings  and/or  specifications  to  define  nonstandard  parts,  appear 
to  fall  into  several  Identifiable  categories:  * 

(1)  Documents  that  restrict  certain  dimensional  or  performance 
(other  than  environmental)  characteristics  to  more  stringent  requirements  than 
those  of  the  most  similar  military  specification. 

(2)  Documents  that  establish  performance  under  more  strlngeot  en¬ 
vironmental  requirements  than  those  of  the  most  similar  military  specification. 

(9)  Documents  that  restrict  sources  of  supply  to  a  narrower  list  than 
those  contained  in  the  QPL  associated  with  the  most  similar  military  specification. 

(4)  Documents  that  contain  requirements  of  the  most  similar  military 
specification  when  no  military  QPL  exists, 

(6)  Documents  that  define  the  characteristics  of  a  part  when  no  mili¬ 
tary  specification  exists  (for  a  similar  item). 

Examination  of  some  military  electronic-parts  specifications  reveals  (In  com¬ 
paring  the  environmental  requirements  with  the  teat  methods  of  MIL-3TD-202  and 
1HL-STD-446,  "Environmental  Requirements  for  Electronic  Parte")  that  many 
existing  nonstandard  parte  are  nonstandard  only  because  the  military  electronic -parts 


specifications  have  not  been  leapt  currant  with  the  equipment  designers'  needs.  Many 
specifications  can  be  Immediately  updated  on  the  basis  of  contractor  test  data  on 
file  In  the  military  electronic  -equipment-procuring  activity. 

8.2  Engineering-  Drawings: 

The  most  recent  specification  (MIL-D-70327)  governing  the  requirements  for 
engineering  drawings  treats  only  generally  the  technical  content  of  documents  pre- 
pared  (by  contractors)  for  purchased  parts.  The  major  concern  seems  to  bo  the 
identification  of  sources  of  supply  for  spare-parts  reprocurement  and  for  designa¬ 
tion  of  the  basic  part-mnabei  Identification. 

In  the  preparation  of  documents  to  serve  the  purposes  of  section  0. 1(1)  or  (2), 
the  contractor  must  determine  whether  the  supplier  Is  obtaining  such  parts  by  selec¬ 
tion  inspection,  and  if  so  he  must  Identify  the  characteristics  associated  with  the 
selection  and  must  identify  the  supplier's  part  number  for  the  unselected  item. 
Further,  if  the  supplier  chooses  not  to  reidentify  (assign  new  part  number  to)  the 
selected  item,  the  contractor's  document  number  must  be  treated  as  the  basic  part 
identification. 

0.3  Recommendations . 

(1)  It  is  urgently  recommended  that  a  vigorous  military  specification 
program  be  established  to  bring  all  military  electronic-parts  specifications  up  to 
current  design  demand  with  respect  to  the  environmental  requirements,  and  that 
existing  data  in  military  activity  files  serve  as  the  basis  for  substantiating  the  parts' 
capabilities.  (See  report  of  Subgroup  ST-4,  which  follows. ) 

(2)  It  Is  recommended  that,  for  those  items  not  completely  described 
by  military  specifications,  military  contractors  and  subcontractors  be  required 
contractually  to  submit  copies  of  their  procurement  documents  for  electronic  com¬ 
ponent  parts  (drawings  or  specifications)  to  a  central  organization  in  the  Department 
of  Defense,  along  with  test  data  substantiating  the  conformance  of  these  parts  to 
such  documentation. 

(3)  R  is  recommended  that  military  contractors  and  subcontractors 
be  required  contractually  to  use  the  test  methods  of  MIL -STD-202  In  their  procure¬ 
ment  documents  for  electronic  component  parts. 

(4)  It  is  recommended  that  the  contractor  and  subcontractor  data. 
Identified  in  recommendation  (2)  serve  as  the  basis  for  the  establishment  of  failure 
rates  and  the  preparation  of  revised  and  new  military  specifications  for  component 
parts. 


(8)  It  la  recommended  that  the  failure -rate  data  be  analyzed  and  pub¬ 
lished  in  a  suitable  form,  such  as  Department  of  Defense  handbooks,  for  contractor 
and  subcontractor  use  In  the  prediction  of  electronic  systems  reliability. 

(0)  It  is  recommended  that  MIL -STD-202  be  expanded  to  cover  the 
current  and  anticipated  environmental  levels  established  in  MIL-3TD-446,  "En¬ 
vironmental  Requirements  for  Electronic  Parts." 

(7)  It  la  recommended  that  consideration  be  given  to  the  use  of  EA1I 
(electronic  accounting  machine)  methods  for  the  storage  and  retrieval  of  parts 
Information. 

49 


7.  Typical  Publication*  and  Prolecta  Containing 
Application*  and  rtaUftblUtTHafiT  . 

7. 1  Publications, 

Cooling  Techniques  and  Components  for  Ground  Electronic  Equipment 
Cornell  Aeronautical  Laboratory,  Inc. 

Design  Manual  of  Methods  of  Forct/d  Air  Cooling  Electronic  Equipment, 

hrxvsmih  m=mrfizs  ices: -  -  — 

Electron  Tube  Derating  Data.  New  York:  McGraw-Hill  Book  Company,  Inc. 

Electron  Tubes,  Techniques  for  Application  of  in  Military  Equipment. 

- - 

Electronic  Designers  Shock  and  Vibration  Guide  for  Airborne  Applications. 
Wright  Air  iWelopment  Center,  Technical  Report  68363,  EecemEeSTTSSS. 

NEL  Reliability  Design  Handbook.  U.  S.  Navy  Electronics  Laboratory, 
Reliability  and  Standards  branch.  Periodically  revised. 

Reliability  Status  Report? ,  Published  by  the  Secretariat,  Advisory  Group  on 
Electron  Tubes,  ni  Broadway,  New  York  13,  New  York. 

Techniques  for  Application  of  Electronic  Component  Parts  in  Military  Equip  - 
ment.  WADC  TR  67-1,  New  l'oric:  McGraw-Hlii  Book  Company,  Inc. 
Volume  I  -  ASTIA  AD  110672;  Volume  H  -  ASHA  AD  142276,  April  1968; 
Volume  HI  -  ASTIA  AD  208681,  June  1969. 

Transistor  Application  Manual,  Techniques  for  Application  of  Transistors  in 
Military  Equipment.  101-16-143,  b$  May  1  ftM,  Arlnc  EesearcE 

Corporation. 

7.2  Projects. 


"Electron  Tube  Research  for  Reliability,"  Cornell  University. 
"TUbe  Surveillance  Program,"  Arlnc  Research  Corporation. 


•UBTAflK  4 
1.  Summary 


In  this  report,  Subgroup  ST-4  submits  detailed  recommendation3  and  support¬ 
ing  data  on  (1)  an  outline  oil  form  and  instructions  for  preparing  design  and  procure¬ 
ment  documentation  for  military  parts  and  (2)  procedures  for  coordinating  specifi¬ 
cations. 


t.  Statement  of  Mtasloa 

The  assignment  of  Subgroup  ST-4  vas  to  review  (1)  present  specification 
writing  and  (2)  coordination  procedures  to  achieve  unification  and  to  ensure  that 
specifications  are  consistent  with  the  full  capabilities  of  the  parts. 


3.  Current  Procedur—  for  Writing  Specifications 

3. 1  Format. 

.  s 

The  physical  and  organizational  format  In  which  the  physical  and  performance 
requirements  of  items  are  presented  la  present  military  documentation  is  not  opti¬ 
mum  for  either  Industry  or  the  Military  Services. 

3. 1. 1  References:  M2 02,  Manual  for  Specifications  (Procedures) 

M203,  for  Standards,  Standardization  Studies 

and  Handbooks  (Procedures) 

M2 04,  Manual  for  Qualified  Products  Lists 
M205,  Outline  of  Form  and  Instructions  for  the  Prepara¬ 
tion  of  Specifications 

M2 06,  Outline  of  Form  and  Instructions  for  the  Prepara¬ 
tion  of  Standards,  Standardization  Studies,  and 
Handbooks 

3. 1.2  Remarks;  The  format  described  by  the  references  Is  inadequate  and 
Incorrect  with  regartTlo  the  following: 

(1)  It  does  not— 

(a)  define  the  relationship  between  the  various  documents  used, 
l.e.,  military  standard,  specification  sheet,  specification,  qualified  products  list, 
eto. ; 


(b)  assure  that  descriptive  Information  required  for  design  and 
irocureinftnt  Is  placed  on  specific  documents  as  completely  as  is  needed  by  the  users 
[military  or  Industrial); 


(c)  provide  &  ready  means  of  identifying  other  related  document* 
when  only  one  Is  available. 

'2)  It  .Ices—  •• 

(a)  result  la  a  tremendous  duplication  of  effort  throughout  a  siz¬ 
able  percentage  of  contractors  to  the  government.  This  duplication  of  effort  occurs 
In  companies  which  maintain  standards  departments  and  which  are  forced  to  "revise" 
military  documents  to  make  them  usable.  This  situation  continues  year  after  year 
to  the  extent  of  940  to  $60  million  per  year. 

(b)  result  in  unnecessary  confusion  in  the  minds  of  not  only  con¬ 
tractors  to  the  government  but  also  military  personnel.  Tbs  cost  at  each  confusion 
can  only  be  measured  is  millions  of  dollars. 

3. 1.3  Recommendations:  In  order  to  eliminate  the  duplication  and  confusion 
regarding  format,  document  content  and  document  relationship,  it  is  recommended 
that: 


(1)  A  project  be  established  Immediately  within  the  Department  of 
Defense  to  prepare  and  Issue  a  policy  manual,  using  ss  a  guide  the  Information  con¬ 
tained  in  Volume  n,  section  3,  "Outline  of  Form  and  Instructions  for  Design  and 
Procurement  Documentation  for  Military  Components." 

(2)  All  other  existing  (M201,  M2 02,  M2 03,  M2 04,  M205  and 

M208)  be  revised  as  recommended  in  this  report. 

(3)  All  Individual  problems  defined  herein  (or  in  reports  of  other  sub¬ 
groups),  together  with  specific  recommendations  thereon,  be  carefully  considered 
In  tbs  revision  of  existing  manuals. 

(4)  An  advisory  group  from  industry  be  appointed  to  assist  the  Depart¬ 
ment  of  Defense  In  this  project. 

3.2  Item  Numbering. 

Item  (part)  numbering  practices  are  inadequate  and  confusing  In  present 
military  specifications  and  military  standards. 

3.2.1  References:  M2  Ob,  4.1.2;  M20C,  3.  fl  and  3. 6. 1;  DOD  Directive 

No.  4120.3;  MIL-3TD-130;  KTL-3TD-208. 

3.2.2  Remarks:  In  specifications  prepared  by  the  Armed  Services  Electro- 
Standards  Agency  (A8E3A),  the  marking  paragraph  In  section  3  details  what  is.  to  be 
marked  on  tbs  item.  It  may  vary,  depending  upon  whether  the  complementary  doc¬ 
ument  used  with  the  specification  is  a  military  standard,  specification  sheet,  detail 
specification  or  drawing,  jet  id. 

3.2.3  Recommendations:  In  oruar  to  eliminate  inadequate  and  confusing  Item 
(part)  numbering  practices,  it  is  recommended  that  this  subject  be  made  a  part  of 
the  scope  of  the  project  to  revise  existing  Department  o 2  Defense  policy  manuals, 
as  follows: 


(1)  TO  establish  a  number  to  Identify  the  item  for  callout  on  an 
assembly  drawing; 

62 


(2)  To  establish  a  number  which  will  provide  an  "address"  to  other 
aaaoelatad  documents; 

(3)  To  establish  a  number  which  will  remain  unchanged  *ren  wherr 
'  military  standardisation  takes  place; 

(4)  To  establish  definitive  ground  rules  for  determining  a  change  In 
part  number  owing  to  a  change  In  technical  requirements  for  the  Item. 

(6)  To  establish  Instructions  regarding  when  the  number  will  be 
marked  on  the  Item. 

3.3  Intended  Use  of  Hems. 


Tbs  "intended  use  of  items"  Is  neither  uniformly  (from  one  specification  to 
soother}  nor  dearly  defined  In  present  military  specifications. 

3.3.1  References:  14205,  3.9,  3.10,  3.30. 

3.3.2  Recommidattons:  It  Is  recommended  that  the  referenced  paragraphs 
of  11206  be  revised  to  more  clearly  distinguish  between  the  "Intended  uses"  for 
Inclusion  In  tits  "Scope*  section  or  the  "Notes"  section  of  the  specification. 

3.4  language  Ambiguity. 

Present  military  specifications  are  being  written  In  language  which  pre¬ 
supposes  that  the  government  Is  tbs  only  "buyer"  In  spite  of  the  fact  that  there  would 
be  little  or  no  need  for  government  procurement  if  Industry  had  not  first  created  a 
need  by  design  and  had  carried  out  the  production  procurement. 

3.4.1  References:  M201A,  2.2(6),  2.3,  2.6,  2.7;  11202,  especially  section 

3;  14203A;  11206,  1.1,  1.2;  DOD  Directive  No.  4120.3, 
eepeclally  section  VHD. 

3. 4.2  Remarks:  The  foregoing  references  stats  that  the  required  orientation 
of  military  specifications  is  In  the  direction  of  procurement  for  government  end  use; 
e.  g. ,  DOD  Directive  No.  4120. 3.  Also,  paragraph  2. 3  of  Standardization 

11201  states  that  "Tbs  atsodardi***ion  program  outlined  in  this  manual  covers  only 
those  items  used  by  the  mili**-./  departments  and  maintained  by  them  in  their  supply 
systso  j." 

3.4.3  Recommendations:  It  is  recommended  that  a  study  be  made  to  deter¬ 
mine  whether,  within  the  framework  of  existing  DOD  directives,  it  is  possible  to 
eliminate  euch  ambiguous  words  as  "government  Inspector”  and  "government  pro¬ 
curement”  In  favor  of  "procuring  activity  Inspector"  and  "using  activity  procurement." 

3.6  Footnotes  to  Tables. 

Too  many  "footnotes"  appear  in  present  military  specification  under  tables 
showing  groupings  of  tests.  Many  times,  this  causes  the  tables  to  become  pert  of 
the  test  procedures. 

3.  6.  1  Reference:  14206,  2. 12. 


3. 5.2  RftcommgndAtions:  It  Is  recommended  that  the  referenced  paragraph 
of  84205  be  revised  to  caution  strongly  against  the  use  of  footnotes  within  s  table 
that  would  cause  the  tables  to  become  a  part- of  succeeding  teat  procedure*;  ■ 


3.5  Performance  Requirements. 

Some  specifications  state  requirements  In  terms  of  "design"  without  including 
suitable  performance  requirements,  ever,  when  they  are  available. 

3.2,1  References:  M2 02,  1.2,  1. 4;  M206,  2. 4  through  2. 4. 2. 

3. 0. 2  Remarks:  Paragraph  l.  2  of  M202  states  that  the  specification  shall 
state  requirements  lo  the  extent  necessary  to  obtain  items  of  requisite  quality,  con¬ 
sistent  with  military  needs  and  current  industrial  technical  and  potential  capabilities. 
Paragraph  1.4  of  M2 02  states  that  specifications  usually  include  both  performance 
and  design  requirements  but  that,  In  some  cases,  design  requirements  are  In  order 
where  It  Is  desirable  to  control  design  In  ail  or  In  certain  respects.  Paragraphs 
2.4  through  2. 4.2  of  M205  state  essentially  the  same  philosophy. 

S.  6. 3  Recommendations:  The  referenced  paragraphs  of  M202  and  M205 
should  be  revised  to  emphasise  the  very  Important  need  to  express  requirements 
for  items  in  terms  of  performance.  The  revisions  should  make  It  clear  that, 
although  there  are  specific  cases  In  which  It  is  permissible  to  specify  requirements 
in  terms  of  design  (dimensions,  for  example,  to  establish  Interchangeability  of  the 
items),  the  specification  of  requirements  in  terms  of  design  should  ordinarily  be 
permittee  only  when  it  Is  clear  that  the  know-how  to  express  the  requirements  in 
terms  of  performance  does  not  exist  It  should  be  emphasized  also  that  whenever 
requirements  for  a  particular  characteristic  of  an  item  have  been  specified  for  both 
performance  and  design  and  a  failure  occurs.  It  Is  sometimes  very  difficult  to 
determine  the  real  cause  of  the  failure. 

3.7  Environmental  Requirements. 

Specification  requirements  are  not  1 1  la  ted  to  equipment  environmental  re¬ 
quirements. 


3. 7. 1  References:  (No  policy  exists  on  this  problem. ) 

3. 7. 2  Rscommendatloast  It  Is  recommended  that  this  problem  be  specifically 
recognised  by  suitable  references  in  revisions  to  either  M2 02  or  M206.  This  re¬ 
vision  should  emphasise  the  fact  that  any  equipments  must  be  built  from  smaller 
"Mock*"— the  Individual  parte.  Accordingly,  "realistic"  performance  of  the  equip¬ 
ment  depends  .upon,  and  cannot  be.  divorced  from,  the  performance  of  the  parts.  As 
a  result,  "realistic"  and  "reliable"  equipment  performance  requirements  should 
seldom  bo  ee  severe  as —and  never  more  severs  than— those  of  the  parts  to  be  used 
therein. 

3.8  Reference  Specifications. 

A  consistent  procedure  for  selecting  reference  specifications  for  section  2  of 
the  specification  Is  not  followed  In  present  military  specifications. 
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3. 3. 1  References:  M205,  2. 5,  2.  ft,  2.  ft.  1,  3. 12  through  3. 13. 

3. 3. 2  Ro  marks;  In  ail  ASE3A-pr spared  specifications,  the  document*  listed 
in  section  2  Include  an  those  referenced  te  aactlona  1  through  5. 

3. 8. 3  Recommendations:  Ho  revisions  to  M2CS  regarding  policy  on  this 
problem  are  considered  necessary.  It  is  recommended,  however,  that  implemen¬ 
tation  of  tlw  policy  be  strengthened  among'all  groups  writing  specifications. 

3*9  Weed  for  New  or  Revised  Specification. 

A  consistent  procedure  is  not  followed  when  it  is  decided  whether  to  revise 
an  existing  specification  or  to  write  a  new  one. 

3.9.1  Reference:  M205.  6.1. 

3-9.2  Recommendations:  It  is  recommended  that  a  policy  be  established 
which  defines  (l)  the  conditions  under  which  multiple  specifications  on  similar  items 
shall  exist  and  (2)  the  conditions  under  which  revisions  to  a  basic  specification  shall 
be  made  as  new  bat  similar  items  become  available.  For  example,  should  re¬ 
quirements  of  specifications  MTL-C- 14157  and  MXL-C-26244  have  been  included  as 
revisions  to  MEL-C-25  rather  than  being  issued  as  separate  specifications?  During 
early  efforts  toward  the  coordination  of  ML-C-14157,  much  time  was  wasted  be¬ 
cause  there  were  no  ground  rules  or  policy  for  this  question.  Again,  should  IflL- 
T-27  be  broken  Into  several  specifications  since  its  coverage  has  now  become  so 
large? 

%wdflc  conditions  of  such  a  policy  can  best  be  established  as  a  part  of  the 
project  recommended  in  section  3. 1. 


3.10  That  procedure  Grouping. 

There  is  no  consistent  organization  of  test  procedure  grouping  (i.  e. .  groups 
A,  B  and  C)  among  the  various  military  specifications.  ^  gro“P» 

3- 10* 1  References:  M205,  3. 24. 1  through  3. 28. 

3- 10. 2  Recommendations:  it  is  recommended  th*t; 

(1)  Paragraphs  3. 24  through  3. 23. 3  of  M205  he  revised  to  establish  an 
agreement  with  the  terminology  of  MIL -STD-109  (referenced  as  a  requirement  in 
paragraph  3. 24  of  M205). 

(2)  The  revision  of  paragraphs  3.24  through  3.2A.  3  include  definitions 
governing  the  quality-assurance  provisions  included  in  Volume  n,  section  3,  Fart 
U2,  paragraphs  11. 1  through  11. 8. 1. 

(3)  -Examples  A,  B  and  C,  quality-assurance  provisions  contained' in 
M206,  should  be  replaced  with  an  example  taken  from  the  sample  capacitor  speci¬ 
fication  MIL-C-0000  (see  Volume  n,  section  4),  which  represent  an  outstanding 
example  of  a  desirable  arrangement. 


3.11  Order  of  Da  tall  Reoulr  era  ants. 

The  sequontlsl  order  la  which  requirement  end  taet  paragraph a  appear  Is  not 
consistent  among  the  various  military  specifications. 

3. 11. 1  References:  M2 06,  3. 20,  3. 24. 1. 

3. 11. 2  Recommendations:  It  Is  recommended  that; 

(1)  Paragraph  3.23  of  M206  be  revised  to  indicate  the  specific  order 
In  which  the  detail  requirements  shall  be  listed. 

(2)  A  new  paragraph  requirement  for  "Detail  Requirement  for  Indivi¬ 
dual  (Material)  Types"  be  added  before  paragraph  3.23. 1,  "Qualification,  ”  of  M2G6 
where  applicable.  The  paragraph  should  read  as  follows: 

Detail  requirements  or  exceptions  applicable  to  particular  types  of 
(material)  shall  be  as  specified  In  the  applicable 'Item  Requirements 
Sheet.  In  the  event  of  any  conflict  between  requirements  of  this 
specification  and  the  Sam  Requirements  Sheet,  the  latter  shall 
govern. 

3.12  Reliability  Requirements. 

Present  military  specifications  contain  neither  reliability  requirements  nor 
reliability  test  requirements. 


3.12. 1  References:  M2 06,  3.23. 5. 1. 


3. 12.2  Remarks:  A  goal  of  the  Ad  Hoc  Study  Group,  of  course,  Is  to  provide 
assistance  on  this  problem. 

3. 12. 3  Recommendations:  It  Is  recommended  that  M2 06  be  revised  as  re¬ 
quired  to  define  the  policy  recommendations  of  the  Ad  Hoc  Study  Group  on  Parts  . 
Specification  Management. 

3.13  Acceptance  Inspection.. 

Specifications  should  contain  a  requirement  that  "parts  supplied  will  have  been 
subjected  to  and  have  passed  specified  acceptance  inspection.” 

3. 13. 1  References:  (Ho  policy  exists  on  this  problem.  However,  see  M205, 

3.23.1,  "Qualification.") 

3. 13. 2  Recommendations:  It  Is  recommended  that  a  new  paragraph  require¬ 
ment,  "Acceptance  inspection,"  be  added  after  paragraph  3.23. 1,  "Qualification,  " 
of  M206.  The  new  paragraph  should  read: 

3.2  Acceptance  Inspection.  The  (material)  furnished  under  this  speci¬ 
fication  shall  be  a  product  that  has  been  tested  and  has  passed  all  the 
requirements  of  acceptance  inspection  specified  herein. 
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Prm rent  military  rpectflgattpg  requirvrnvatv  for  qualification  Impaction  and 
acceptance  Impaction  ar#  not  proparly  Integrated  with  Qualified  Product*  Lint 
requirements. 

3. 14. 1  Reference* :  M205,  3.23.1,  3.24,  3.24.3,  3.24.4;  M204,  1.2  and  10. 

{There  la  no  policy  assuring  any  specific  relationship 
between  Qualified  Products  Lists. ) 

3. 14. 2  Recommendations;  It  Is  recommended  that  the  Interrelationship  of 
qualification  Inspection,  acceptance  Inspection  and  Qualified  Products  Litis,  as 
contained  In  the  report  of  Subgroup  ST-2,  be  established  as  policy.  (See  section 
4.2,  "Subtask  2. ") 

3.15  Policy  Mjugala. 

Requirements  sad  definitions  contained  In  the  various  policy  manuals  are  not 
suitably  Integrated.  Standardisation  mamals  lack  sufficient  guidance  in  certain 
areas,  for  example,  referencing  single -Service  drawings  on  military  standards. 
Provisions  In  manual*  permitting  (a)  addenda,  (b)  "in-lieu-of"  specifications  and 
(c)  interim  amendments  have  resulted  In  a  multiplicity  of  requirements  for  the  same 
Item  (e.g.,  1OL-C-003965). 

3. 15. 1  References;  (a)  See  statement  on  page  V  of  M206:  "Other  standardiza¬ 

tion  manna]*  related  to  this  document  which  should 
be  consulted  for  details  of  procedure." 

(b)  148,  0.2. 1;  14206,  3. 3. 1.1,  3.0.1,  3. 7. 1;  14203A, 

3.3,  8.1;  11202,  7.1,  7.2,  7.3.1. 

3. 15. 3  Recommendations;  It  is  recommended  that: 

(1)  A  very  detailed  cross-check  of  all  policy  manuals  te  made  to  locate 
contradictions  or  Inconsistencies  and  to  Integrate  all  policies. 

(2)  Consideration  be  given  to  revisions,  where  required,  to  control 
the  Issuance  at:  (a)  "in-lleu-cf"  specifications  and  (b)  interim  amendments. 

(3)  Provide  additional  guidance  In  areas  where  experience  has  shown 
there  la  a  need. 

3.10  Standard  Groups  of  Environmental  Requirements. 

Environmental  requirements  are  not  established  In  "standard  groups"  which 
la  turn  refer  to  suitable  standard  test  procedures. 

3. 10. 1  References;  standard  MIL -STD -440,  April  1959.  {This  defines 
"standard  groups*  which  refer  to  standard  teat  procedures,  per  MIL -STD-202. ) 

3. 10. 8  Recommendations;  It  Is  recommended  that  the  preparation  of  all  future 
military  specifications  be  monitored  to  assure  their  preparation  in  accordance  with 
the  requirements  of  Standard  MIL -STD- 440, 
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4.  Procter  a#  for  Coordinating  Specifications 

4.1  Time  Scale. 

As  a  result  of  the  following  problems  (and  others),  the  time  seals  for  the  prep 
arstion,  coordination  and  printing  of  military  specifications  and  standards  Is  corn- 
pie  tel/  unrealistic: 

(1)  The  normal  scheduling  time  (see  'Table  I). 

(2)  The  actual  time  required  (see  Table  U,  examples  representative 
of  average  time  required). 

(3)  The  coordination  flow  chart  requirements  contained  In  M2 02. 

(4)  The  Military  Services  do  not  provide  equivalent  backing  to  per¬ 
sonnel  allowed  to  participate  In  coordination  actions.  One  Service  may  always 
officially  endorse  its  representatives 1  decisions,  while  another  Service  may  have 
not  the  slightest  hesitacce  in  disapproving  decisions  of  its  representatives. 

(5)  Too  much  time  Is  wasted  in  haggling  over  detail  requirements. 

The  reasons  for  this  are: 

(a)  Lack  of  experience  of  personnel  available  for  coordination 

action; 

(b)  Nbnstandardfcsation  of  environmental,  requirements  for  elec¬ 
tronic  parts; 

(c)  The  absence  of  "cross  pollination"  among  the  various  co¬ 
ordinating  groups; 

(d)  Lack  of  authority  by  the  coordinating  activity  to  resolve 
differences  of  opinion  and  thus  terminate  actions. 

(6)  The  coordinating  agency  lacks  authority  to  "crac  k  the  whip"  and 
speed  up  the  coordination  action.  This  situation,  must  continue  as  long  as  the  exist¬ 
ence  of  the  coordinating  activity  depends  upon  a  charter  created  by  the  three 
Military  Services.  It  is  obvious  that  no  Military  Service  will  allow  Itself  to  be  sub¬ 
ject  to  criticism  by  an  activity  it  helps  to  create  and  maintain. 

(7)  The  coordinating  activity  "does  not  exist"  In  the  jyea  of  the  De¬ 
partment  at  Defense. 

(8)  Failure  of  the  Department  of  Defense  to  provide  in  organization 
or  procedure  which  Is  able  to  assure  the  necessary  expeditious  action. 

(9)  Failure  of  the  Services  to  bring  "essential"  comments  to  notice. 

(10)  Submission  of  comments  as  "essential"  which,  in  truth,  should 
have  been  "suggested"  or  even  "editorial. " 
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4.1.1  Refer  gncas:  11202,  5. 11.2  (quoted  below),  flow  charts, 

b.  ii.2  Action  to  rwoiV#  essential  comment*.'—1 The  drift,  custodian 
comment*,  the  record  of  reconciliation  effort*,  and  a  departmental 
recommendation  for  disposition  of  unresolved  essential  comments 
shall  be  submitted  to  the  Standardization  Division  for  action  through 
the  assignee  activity  and  Its  DepSO,  with  copies  of  the  transmittal 
letter  to  the  other  custodians  nod  DepSO's.  This  procedure  for 
submission  of  a  draft  to  the  Standardization  Division  provides  suc¬ 
cessive  opportunities  for  reconciliation.  The  Standardization  Div¬ 
ision  will  take  appropriate  action  to  resolve  the  essential  comment* 
and  forward  the  specification  to  the  preparing  activity  for  printing, 
with  copies  of  the  letter  to  the  assignee  activity,  custodians,  and 
the  DepSO'c. 

4. 1. 2  Recommendation*:  In  order  that  the  coordination  procedure  may  be 
completed  in  a  reasonable  time,  it  1*  recommended  that  an  Advisory  Group  on 
Management  of  Electronic  Parts  Specifications  be  established  as  an  activity  of  the 
Ofdce  of  the  Assistant  Secretary  of  Defense  (Supply  and  Logistics),  to  have  the 
functions  detailed  in  Volume  I,  section  2,  recommendation  (1). 

4.2  Limited  Coordination. 

Because  a.  v  ck  of  control  over  the  issuance  of  Limited  Coordination  Mili¬ 
tary  Specification  other  then  by  the  Military  Services  involved),  It  is  much 
easier  for  the  interested  Service  to  continue  Issuing  this  type  of  specification  than 
it  Is  to  wait  for  the  official  coordination  action.  Accordingly,  tbs  Individual 
Services  handle  their  specification  problems  In  exactly  the  same  manner  a*  their 
customer*  handle  theirs— by  writing  their  own.  As  a  matter  of  fact,  this  feeling 
is  so  commonplace  among  toe  military  personnel  that  It  is  reported  that  a  re¬ 
sponsible  representative  of  one  of  toe  Services  has  publicly  stated  that,  as  a 
result  of  the  difficulty  In  establishing  full  coordination,  his  Service  in  the  future 
intends  to  continue  writing  Its  own  specifications  and  to  take  little  or  no  action  with 
regard  f  ?  their  coordination. 

4.2. 1  References:  M202,  7.2  (quoted  below),  revised  5  May  1958. 

7.2  Limited  coordination  military  specification  "Used  in  Lieu  of”  a 
military  coordination  specification— When  the  procurement  of  an  item 
with  changed  requirements  does  not  allow  time  to  coordinate  a  re¬ 
vision  to  a  coordinated  military  specification,  any  DepSO  may  ap¬ 
prove  the  justified  request  of  the  requiring  activity,  submitted 
through  toe  departmental  custodian  to  issue  a  specification  "Used 

In  Lieu  of”  the  feinting  specification.  The  specification  will  then 
be  Issued,  u  approved,  by  toe  requiring  activity.  The  need  for  a 
"Used.  In  Lieu  of”  specification  will  be  carefully  reviewed  by  the 
DepSO  In  order  that  a  minimum  number  of  these  documents  will  be 
issued.  The  preparing  activity,  assignee  activity  and  Standardiz¬ 
ation  Division  will  be  informed  of  all  such  approvals  by  toe  DepSO's. 
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4.2.2  Recommendations:  It  la  recommended  that: 


(1)  A  continuing  program  be  established,  to  result  In  a  "normal’' 
scheduler  time  of  26  weeks  (from  Inception  to  completion  of  printing)  for  ruir  military 
and  Industrial  coordination  of  electronic -parts  specifications. 

(2)  Approval  of  ths  preparation  and  Issuance  of  Limited  Coordination 
Military  Specifications  be  made  a  responsibility  of  an  office  at  the  Office  of  the 
Secretary  of  Defense  '  vel  instead  of  the  individual  Military  Service. 

(3)  Approval  of  the  preparation  and  Issuance  of  Limited  Coordination 
Military  Specifications  be  based  upon  a  satisfactory  Justification,  to  be  prepared  by 
the  Military  Service  concerned. 

(4)  A  suitable  record  of  activities  relating  to  electronic -parts  speci¬ 
fications  throughout  the  Military  Services  be  maintained  by  an  office  at  the  Office  of 
the  Secretary  of  Defense  level,  for  reference  purposes  and  to  prevent  duplicating 
activities  to  this  field. 

(5)  Existing  definitions,  regulations  and,  perhaps,  the  name  "Limited 
Coordination  Military  Specifications"  be  revised  to  ensure  that  they  will  be  binding 
upon  all  other  Military  Services  Immediately  upon  issuance,  except  that  a  period 

of  60  days  udli  be  allowed  any  Service  to  show  why  the  specification  Is  not  satis¬ 
factory  for  Its  use. 


5.  Instructions  for  a  Documentation  System 

Section  3  of  Volume  n  of  the  Ad  Hoc  Study  Group's  report  is  an  "Outline  of 
Form  and  Instructions  for  Design  and  Procurement  Documentation  for  Military 
Parts." 


TABLE  111(A).  COMPARISON  OP  ENVIRONMENTAL  REQUIREMENTS 


i 


i 


t> 

S 

J, 


Environment 

Group  IV  MIL-3TD-446 

MIL-C-0000 

Temperature: 

Operating 

-65°C'  ♦125°C 

•-55°C  ♦125°Cr 

Storage 

-65°C  +65°C 

00 

Thermal  (hock 

-65°C  +123 OC 

•  • 

Preeaure: 

Operating 

.326  In.  Hg 

•3. 44  in.  Hg 

Altitude  (ft) 

100, 000  ft 

•50,000  ft 

Nonoperating 

INA 

Moiature  (100%  RH) 

10C 

IOC 

Vibration: 

Cjrclee  per  aecond 

10-2000 

10-2000 

Acceleration  (g) 

10 

10 

Shock: 

Acceleration 

50 

50 

Tima  (me) 

11  il 

11  ±1 

Air- induced  vibration: 

Cycle*  <er  second 

150-0600 

*• 

Dd  i  »y.  i  2x10** 

dyi—./aq  cm 

165 

00 

Acceleration  (constant): 

Gravity  units 

No  requirement 

50 

Time  (sec) 

No  requirement 

5 

Explosive  atmosphere 

Proc  I  -  M1L-E-5272 

•  • 

Nuclear  radiation  (pulia): 
Neutron  flux  laral  (faat): 


Neutroa/cm^-aec 

10” 

*• 

Time  (microeec) 

Gamma  flux  level: 

§0 

00 

ftoentgens/sec 

10» 

00 

Time  (microeec) 

60 

00 

Sand  and  dust 

Moving  parts  only 

NA 

•alt  atmosphere 

96 

••4g 

Flammability 

Para  6.2.13 

00 

Fungus  resistance 

Nonnutrient 

Nonnutrient 

Life  (hr): 

Operating 

IK 

IK 

Storage 

SOX 

00 

NOTES:  ‘Deviation  from  MIL-STD-446  level  owing  to  the  etate  of  the  art 
In  the  item  under  epecUtcatton.  Level  of  operation  may  be 
obtained  bp  derating. 

••At  this  time,  teat  data  are  not  available  to  permit  Inclueton  of 
requirement  In  opacification. 

INA  -  Thla  environment  not  applicable  to  the  uae  of  thla  Item. 

S3 


EXHIBIT  A 


PARTS  SPECIFICATION  QUESTIONNAIRE 


Studies  have  indicated  that  although  many  company  specifications 
hive  been  written  for  procureaent  of  parts  of  the  ease  generic 
types  covered  by  existing  Military  specifications,  many  of  these 
eonpaay  specifications  would  probably  not  have  been  written  if 
the  Military  specification  had  been  "up-to-date."  Inquiry  has 
indicated  that  "up-to-date”  Means  having,  tor  example,  higher  toa- 
perature  or  higher  vibration  or  higher  shock  or  more  effective 
Quality  Assurance  requirements,  etc.— that  is,  as  high  as  required 
to  bring  the  specification  requirements  up  to  the  level  of  readily 
available  parts  of  the  type  the  Military  specification  describes. 

the  purpose  of  this  questionnaire  is  to  determine  the  concensus  of 
parts  users  regarding  requirements  which  should  be  added  to  existing 
military  specifications  to  bring  them  "up-to-date”  and  in  order  that 
they  may  be  used  to  buy  parts  which -ere  presently  being  procured 
from  one  or  more  manufacturers  by  means  ol  company  specifications, 
this  questionnaire  differs  from  others  which  have  been  prepared  in 
that  it  defines  specific  standard  levels  of  requirements  as  related 
to  specific  parts  specifications",  it  is  believed  such  definition 
will  ce  of  inestimable  value  in  a  much  needed  "modernisation"  phase 
of  a  mandatory  military  program  to  improve  military  specifications. 


1.  Does  your  company  use  parts  of  the  generic  types  described  by 
the  specifications  listed  on  Table  I 17  Example:  If  your 
company  uses  capacitors  of  tbs  general  types  described  by 
KIL-C-396S,  place  check  in  square  iemediately  following  "MIL- 
C-3965"  fo  Indicate  "ye».n 

X.  When  your  company  orders  parts  of  these  generic  types,-  are 
they  identified  on  the  purchaee  order  by  the  exact  part  (or 
type)  number  specified  is  the  specification  (or  MS  sheet) 
with  absolutely  no  additional  "requirements"  or  "conditions" 
specified?  Indicate  "yes”  by  checks  in  tbs  column  hsadsd 
u exact  part  (or  type)  number." 

3.  If  your  company  identifies  the  parts  on  the  purchase  order  lm 
any  other  manner  than  by  the  exact  military  part  (or  type) 
number,  does  your  company— 

a.  Write-  a  company  specification  and  identify  the  items  _ 

by  means  of  a  oompany  part  number?  I  I 

b.  Take  some  other  action?  Define  I'  '  l 
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4.  If  your  antiwar  to  tha  abova  is  '’a'*  doaa  your  coapany  writa  tha 
•pacification— 

a*  To  covar  procuramant  of  a  valua,  tolaraoca,  or 
physical  configuration  oat  2 ivtvtf-  tv  rtrr  military 
•pacification? 

b.  To  brine' tba  apaoif ieatlon  "up-to-c'ata?" 

c.  Tor  soaa  otbar  raaaon?  Dafina _  _ 


5.  If  your  answar  to  tha  abova  ia  "b"  plaaaa  .tndlcata,  in 
"naadad  raquiramaatn"  column  of  Tabla  II,  by  aaana  of  tha 
coda  nuabara  aalactsd  from  Tabla  I,  thoaa  raquiramanta  which, 
if  addad  to  tha  apacific  military  opacification,  would  ia 
your  opinion,  bring  it  "up-to-data." 


TABU  I 


(Xnrironmantal  condition  limita  hava  baan  ctxtractad 
from  Standard  MXL-STC-446  Xnvironmantal  acquirements 
for  Klactronic  Coaponant  Parts) 


Baquiraaant 

Coda 

Requirement 

Coda 

Temperature 

Pressure 

Operating 

"TJpifiJing 

low  -88*C 

T-l 

(In. Eg.)  (Altitude) 

-45*  C 

T-a 

20.83  10,000  ft. 

P-1 

♦Other 

T-3 

1.32  70,000  ft. 

p-a 

■igh  +55* C 

T-4 

.324  100,000  ft. 

P-3 

+48*C 

T-S 

.043  180,000  ft. 

P-4 

+ias*c 

T-4 

•Othar 

P-8 

+200*C 

T-7 

Non-operating 

+350*C 

T-4 

(In. Eg.)  (Altitude) 

+500* C 

T-9 

3.4  80,000  ft. 

P-4 

•Other 

T-10 

•Othar 

P-7 

Storaga 

■oiatura 

Low  -48*C 

1-11 

Hetnod  104-MIL-8TC- 

■igh  +71*C 

T-ia 

202A-19  cyclaa 

M-l 

+4S*C 

T-13 

•Othar 

■-a 

•Othar 

T-14 

Tibration 

Shock 

Bechahicai 

Low  -48* C 

T-18 

10-88  at  .03"  Ampl. 

V-l 

■igh  +48*C 

T-14 

10-2000  at  10Q 

T-a 

♦128*0 

T-17 

10-2000  at  180 

T-3 

♦200*0 

T-14 

10-2000  at  200 

T-4 

♦380*0 

T-19 

10-2000  at  400 

T-8 

♦800* C 

T-ao 

•Othar 

T-4 

•Othar 

T-31 

Air-inducad 

1  180-9.400  epa  at  168db  T-7 

!  *0thar  | 

T-4 

sa 


0  DD  . 


Xequlreaeat 

Code 

Shock  (Impulse) 

500  for  <?  millisecs 

3-1 

500  for  llil  millisecs 

S-2 

•Other 

8-3 

explosive  atmosphere 

mii  mi  rttO'j^rr^TTwm 

•Other 

3-3 

Nuelfthx-  radiation  (sector 

1C10  aeutron/cm*  sec 

for  1000  hrs. 

X-l 

•Other  . 

X-3 

10"  photon/cm*  sec 

for  1000  hrs. 

X-3 

•Other 

X-4 

Muclear  radiation  (pulse) 

1017  neutron/cm*  see 

for  SO  microsecs 

X-5 

•Other 

10*  roeatfens/sec  for 

r-e 

CO  mi crosses 

X-7 

*0thw 

14 

Salt  atmosphere 

Method  10U-M1L-STD- 

302A  for  —  hr** 

-JA-1 

•Other 

SA->3 

Sand  and  Dust 

MIL-I-5372-Procedure  I 

SD-1 

•Other 

9D-a 

fungus  resistance 

i 

MXL-S-8272-Procedure  I 

r-i 

•Other 

M 

Icceleratioa  (constant)** 

500  for  5  see 

4-1 

5000  for  1  see 

A-a 

•Other 

A -3 

Requirement 

Code 

Miscellaneous 

Add  Qualification 
Inspection 

0-1 

Increase  test  sample 

size 

Q-2 

Specif;  lover  AQL 
values 

0-3 

•Other 

0-4 

Add  Acceptance  Inspection 

Provide  Croups  A.IIC  Q-S 

Increase  test  sample  , 
miss 

0-7 

Specif;  lover  AQL 

values 

Q-S 

•Other 

0-® 

Add  date  or  lot  coding 

D»1 

Bevies  test  methods 

TM-1 

Add  test  methods 

TM-S 

Add  other  values, 
tolerances  or  physical 
configurations 

07-1 

*  Defies  "other”  on  Table  II 


ia  "needed  requirement*" 
column.  | 


**  Mot  ia  WL-am-4«« 


TABU  11 


LIST  OT  BJUJUIRBOMTS  MRS  ZD  TO  BRIHO  CXRTAIH  MILITARY 
SPRCITICATIOMS  "UP -TO- DAT*" 


Prepared  by 

Ad  Hoc  Study  Croup  on  Parte  Specification# 
Management  for  Reliability 


Specification 

Generic 

Types 

Used 

Xxact 

Part 

Humber 

Used 

Heeded  Requirements 

1.  Capacitors 

MIL-C-5  (mica) 

CZ3 

CD 

MIL-C-23  (paper) 

ED 

CD 

MIL-C-C965  (tantalum) 

in 3 

CD 

MIL-C-10950  (button  mid 

O 

1 — l 

MXL-C-11015  (ceramic) 

ed 

CD 

M1L-C-112Y2  (glass) 

cd 

CD 

KIL-C-14137  (paper) 

i _ j 

CD 

MIL-C-14409  (trimmer)  j 

cm 

CD 

•Other 

i — i 

1 — l 

ED 

CD 

(=□ 

CD 

ED 

CD 

CZJ 

CD 

S.  Connectors 

MIL-C-S01S 

ED 

CD 

MIL-C-3918 

CD 

CD 

MIL-C-71A 

CD 

ED 

MXL-C-3S0* 

CD 

ED 

i 

06 


f 


2.  Connectors  (Continued) 
•Othsr 


3«  lXactron  tubos 


•OtJurr 


4.  Islaj 


MIL-E-3757 

•Other 


CD 

CD 

CD 

03 

n 

03 

»a»»» 

n 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 


CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 

CD 


8.  Isolators 


MIL-1-11  (composition)  f  '  j  P"""! 

MIL-1-93  (vlrvaouad)  f  1  f  1 

MIL-1-10509  (carbon  flta)  ("'  1  f'H 

MIL-1-94  (vnr  coapoiltico)f"  *  1  C  '  ) 

*Othmr _ .  CD  CD 

_ _  CD  CD 

_  CD  CD 

_  CD  CD 


SggA-c.~Kjuctgr  diodes 


M7L-K-1 

•Other 


7.  Trsasletors 

MIL-T-19600 

•Other 


□□□□□□  ooodod 

□□□□□□  ODDDDO 


EXHIBIT  B 


ieamary  Report  on  Reeulta  of  Farts  apectftcatton  Questionnaire 

20  July  1059 
1.  BACKGROUND 

A  questionnaire,  included  sis  a  part  of  the  report  of  Subgroup  3T-4,  wa3  pra- 
p*.r«d  and  circulated  to  a  wide  segment  of  parte  users  on  20  -July  1959.  The  ques¬ 
tionnaire  was  sent  to  100  different  companies  that  arc  producers' ct  electronic  equip - 
foT  the  Military  Services.  The  mailing  list  was  prepared  by  consultation  with 
Military  Service  representatives  and  with  members  of  the  Aerospace  Industries 
Association's  Electronic  Parts  Committee  (EPC)  and  the  Electronic  Industries 
Association's  Military  Engineering  Components  Coordinating  Committee  (M-l). 
Replies  were  received  from  a  total  of  31  different  companies. 

The  questionnaire  was  prepared  especially  to  attempt  to  identify  the  require¬ 
ments  in  specific  military  specifications  that  could  be  revised  to  result  in  specifi¬ 
cations  which  would  describe  items  which  represent  the  latest  industry  know-how. 

It  was  expected  that  the  results  of  the  questionnaire  could  be  the  basis  for  the  initia¬ 
tion  of  a  Department  of  Defense  "crash"  program  to  update  certain  specifications. 


2.  CONTENTS 

Table  I  (of  this  summary  report)  summarizes  all  the  indicated  requirements 
on  the  basis  of  categories  (temperature,  acceleration,  etc. ).  Table  I  shows  the 
following; 


(1)  Under  the  column  headed  "Total  Usage  Generic  Types”:  the  num¬ 
ber  of  companies  Indicating  they  used  items  of  the  type  covered  by  the  indicated 
specification.  For  example,  25  companies  indicated  they  used  capacitors  of  the 
generic  type  covered  by  MH.-C-5. 

(2)  Under  the  column  heeded  "Total  Usage  Exact  Number":  the  num¬ 
ber  of  companies  indicating  they  identified  items  on  their  purchase  orders  solely  by 
th*  use  of  the  military  specification  identifying  number,  with  no  additional  require¬ 
ments  whatsoever  placed  on  the  items.  For  example,  20  companies  indicated  they 
uiied  the  exact  military  specification  identifying  cumber  when  ordering  capacitors 
to  MEL-C-5. 


(3)  Under  columns  headed  "Requirements":  the  total  number  of  indi¬ 
cations  of  need  for  revision  In  one  of  the  categories.  For  example,  there  _re  8 
indications  of  need,  for  revision  of  the  quality  assurance  category.  (Some  categor¬ 
ies  contain  several  subcategories  and  any  one  company  may  have  Indicated  more 
than  one  subcategory. ) 

(4)  A  review  of  the  numbers  In  the  category  columns  quickly  Identifies 
tk'e*  catenaries  of  the  greatest  concern. 


IM»M  tt  •  41  •  * 
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TUbl*  H  (of  this  summary  report)  summarize*  all  the  Indicated  requirements 
on  the  basis  of  subcategories  (e.g.,  *-66°C  Operating  Temperature"  la  asub- 
c  ate  gory  of  "Temperature'’).  Table  H  shows  the  following: 

(1)  Columns  heeded  "Total  Usage  Generic  Types"  and  "Total  Usage 
Exact  Number"  are  explained  In  connection  with  Table  1,  paragraphs  (1)  and  (2). 

(2)  Under  column  heeded  "Requirements”:  the  number  of  companies 
indicating  the  need  for  revision  in  the  specific  subcategory.  For  example,  11  com* 
panlee  indicated  the  need  to  revise  1CL-C-5  to  Include  126°C  operating  temperature. 

(3)  It  is  recognized  that  certain  revisions  may  be  Indicated  as  needed 
when  the  requirements  already  exist  In  the  specification.  No  attempt  has  been  made 
to  edit  the  indicated  requirements. 


3.  CONCLUSIONS 

From  the  results  of  the  questionnaire,  the  following  conclusions  can  be  drawn: 

(1)  The  listed  military  specifications  could  be  revised  to  bring  them 

up  to  date. 

(2)  There  Is  sufficient  agreement  of  parts  users  with  regard  to  re¬ 
quirements  that  the  availability  of  up-to-date  military  specifications  would  greatly 
reduce  the  number  of  company  specifications  being  written. 

(3)  The  availability  of  up-to-date  military  specifications  would  greatly 
reduce  the  cost  at  present  nonstandard-part  approval  procedures  by  reducing  the 
number  of  nonstandard  parts. 

(4)  Purls  representing  the  requirements  indicated  by  the  reporting 
companies  and  technical  data  thereon  exist  as  a  result  of  procurement  of  the  parts 
by  toe  companies.  These  same  technical  data  can  also  be  found  In  the  record  files 
cf  to*  individual  Services  as  a  result  of  existing  nonstandard-part  approval  pro¬ 
cedures. 

(6)  Results  tabulated  la  Tables  I  and  n  will  be  very  useful  in  estab¬ 
lishing  the  requirements  and  procedures  of  a  program  to  revise  certain  specifica¬ 
tions  to  bring  them  up  to  date. 

(0)  Such  a  revision  program  Is  needed.  It  is  feasible.  It  is  Justifi¬ 
able.  Technical  data  are  available.  This  summary  presents  starting  points  for 
such  a  program. 
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Tabl#  !.  Combined  Hamlramanta  ! 


•pacifi¬ 
st  lorn 

Voabar 


■Ik-C-3 

MIL-C-35 

MIL-C-3009 

M1L-C-10850 

M1L-C-U019 

mt-c-nm 

MIL-C-14107 

MIL-C-9M44 

MIL-C-14400 

MIL-C-4I 

MIL-C-M 

ML-C-5015 

XIL-C-3M0 

MIL-C-71 

4IL-C-3404 

UL-C-3394 

MIL-S-570? 

klL-«~S8ClS 

MIWI-11 

UL-a-ii 

HIMt-10909 

BIL-4-94 

UUI-M 

4II/-3-11904 

wt-a-i» 

ML-JU9444 

MIX4-11 

UL-ff-USOO 

aiL-t-i 

UiadM) 

MIL-I-1 


Aft 


Raauir 


39 

30 

‘ — 

39 

3ft 

1? 

19 

33 

13 

13 

13 

13 

13 

13 

13 

1* 

31 

14 

17 

• 

3 

8 

7 

4 

ft 

14 

9 

11 

7 

31 

3 

3 

4 

4 

34 

17 

14 

17 

13 

11 

17 

13 

14 

13 

19 

11 

10 

3 

ft 

33 

4 

19 

13 

3 

9 

• 

4 

• 

33 

19 

10 

37 

17 

• 

31 

14 

11 

3 

3 

3 

3 

4 

9 

4 

3 

7 

9 

3 

4 

3 

13 

14 

10 

31 

19 

9 

34 

91 

19 

Wit 


1 

3  4  1 

*  3  3 

3  ft  3 

3  4  3 

3  4  3 

1  11  3 

1  ft  3 

4  1 

3  1 

3  3 

ft  3 

1 


*  •  • 

1  T  4 

•  4 


Specifi¬ 

cation 

Jfu»b#r 

Total 

Uaage 

Generic 

Types 

Total 

Usage 

Exact 

ifuuber 

Requlrenents 

MIL-C-5 

23 

20 

(T-m 
(T-2) 2 
(T-8) 11 
(T-7) 1 
(T-ll)3 
(T-13) 1 

(T-15)3 
(T-lfl)3 
(T-18) 1 
(P-2)  5 
(P-3) 1 
(M-Dl 

(7-2)1 

(7-3)2 

(7-4)3 

(7-8)1 

(7-7)1 

(8-2)3 

(3-3)2 

(3A-1) 1 

<7-1)1 

(A-l)l 

(A-3)) 

(0-2)1 

(0-3)1 

(0-4)1 

(0-8)1 

(0-9)2 

(D-l)2 

(OV-l)7 

MIL-C-25 

25 

17 

(T-l)l 

<T>6)4 

<T-11)4 

(T-13) 2 

(T-15)2 

(T-17)2 

(P-l)l 
(P-2) 2 
(P-3) 1 
(V-2)4 
(V-3)l 
(V-4)l 

(7-0)2 

(7-7)1 

<8-1)1 

(5-2)2 

(8-3)1 

(P-l)l 

(A-l)2 

(0-2)3 

(0-3)1 

(0-4)1 

<0-6)2 

(0-7)1 

(0-«)2 

(0-9)3 

(D-l)3 

(07-1)6 

MIL-C-3865 

23 

13 

<T-2) 1 
(T-8) 2 
(T-ll)4 
(T-13) 1 
(T-15)2 

(T-17)2 
(P-3) 1 
(7-2)1 
<7-6)2 
(7-7)1 

(3-2)3 

(7-1)1 

(A-l)2 

(0-2)2 

(0-3)2 

(0-4)1 

(0-8)1 

(Q-7)l 

(0-«)l 

(0-9)1 

(D-l)2 

(0V-1)7 

HIL-C-10930 

18 

13 

(T-l)l 
(T-2) 1 
(T-8) 3 
(T-7)l 
(T-U)l 

(T-13)  2 
(T-?,7)2 
(T-18) 1 
<P-2)2 
(V-3)l 

(K-l)l 

(7-2)1 

(7-4)1 

(7-6)1 

(7-7)1 

(A-l)l 

(0-2)1 

(0-3)1 

(0-4)1 

(0-8)2 

(0-7)2 

(0-8)2 

(0-9)1 

(D-l)l 

(07-1)3 

VZL-C-2101S 

17 

13 

(T-l)l 
(T-2) 2 
(T-8)8 
(T-7)l 
(T-ll)l 
(T-13) 3 

\T-1T)3 
(?-J3)\ 
(P-2)  3 
(P-3) 1 
01-1)1 
(7-2)2 

(7-3)1 

(7-4)3 

(7-8)1 

(7-7)1 

(3-2)1 

(3-3)2 

(SA-'l)l 

(A-l)l 

(A-3)l 

(0-2)1 

<0-3)3 

(0-4)1 

(0-8)1 

<0-9)1 

(D-‘)2 

(07-1)6 

KZt-C-11272 

21 

14 

(T-l)l 
(T-2> 1 
(T-fl)3 
(T-7) 1 
(T-ll)3 
(T-13) 1 

(T-15)3 

(T-17)i! 

(T-18) 1 

(P-2)4 

(H-l)i 

(7-2)2 

<7-3)1 

(7-4)1 

(7-6)2 

<7-7)1 

(8-3)2 

<3-3)1 

(7-1)1 

\A-1)1 

(0-3)1 

(0-3)1 

(0-4)1 

(0-8)1 

(0-9)1 

(0-1)2 

HU-C-14137 

» 

e 

1T-11)2 

(1-12)1 

(T-18) 1 
(P-2) 2 

(7-3)  1 
<7-1)1 

<A-1)1 

(0V-1)3 

ttU.~02624« 

7 

4 

(1-11)2 

(T-18)2 

(T-17) 1 
(7-4)1 

(7-8)2 

(7-7)1 

(P-3)l 

(3-2)1 

(7-1)1 

MJL-C-14409 


14 


3 


MIL-C-32 
MI L-C-20 

MXL-C-5015 

MIL-C-3989 

MIL-C-71 

MIL-C-3608 

MIL-C-8384 

MIL-R-5737 

MIL-R-23018 


14 

3 

'  01 

(T-17) 2 

(V-4) 1 

(0-2)2 

(0-9>i 

V--«>2 

(T-18) 1 

(V-8) 1 

(0-3)2 

(D-l)2 

(T-7)  1 

(?-2)2 

(V-7>i 

(0-4)1 

(OV- 1)3 

(T-il)l 

(P-3)  1 

(3-1)1 

(0-6)1 

<  r-i3) i 

(M-l) 1 

(3-2)1 

(0-7)1 

<T-13)2 

(V-2) 2 

(A-l)2 

(0-8)1 

7 

3 

(T-8)l 

(T-ll)l 

(TM-1) 1 

(07-1)2 

S 

4 

(T-l)  l 

(T-li)l 

(V~2)l 

(A-l)l 

(P-2) 1 

(T-S) 1 

(T-13)l 

24 

17 

(T-l) 1 

(T-17) 2 

(V-3) 1 

(Q-2) 1 

(Q-9) 1 

(T-8)4 

(T-18) 1 

(V-4) 1 

(0-3)1 

(0-1)2 

(T-7) 1 

(P-2)2 

(3-2)1 

(0-4)1 

(TM-1) 1 

(T-ll)2 

(P-3)l 

(SA-1) \ 

(0-8)1 

(Tn-2) 1 

(T-13) 1 

(M-l) 3 

(30-1)1 

(Q~7)l 

(C7-l)3 

(T-15J2 

(V-2) 2 

<A-1)1 

(Q-8)l 

17 

13 

(T-l)l 

(T-13)l 

(V-4)  1 

(0-2)1 

(TM-1) 1 

(7-2)2 

(7-15)1 

(V-6)l 

(0-3)1 

(TM-2)1 

(T-6)  1 

(T-18)l 

(3-2)2 

(0-4)1 

<0V-1)2 

(T-7) 1 

(P-2) 1 

(SD-l)l 

(0-8)1 

(T-9) 1 

(P-3) 2 

(A-l)l 

(0-9)1 

<T-11)2 

(M-l)2 

(Q-l)l 

(0-1)2 

17 

13 

(T-l)l 

(T-13) 2 

(V— 4) 1 

(0-2)1 

(TM-1) 1 

(T-2) 2 

(T-16)l 

(V-8) 1 

(0-3)1 

(TH-2)2 

(T-8)2 

(T-18)l 

(3-2)  “ 

(0-4)1 

(0V-1)2 

(T-7)l 

(P-2)  2 

(3A-£)1 

(0-6)1 

(T-9) 1 

(P-3)  2 

(30-1)1 

(0-8)1 

(T-ll)2 

(M-l)  3 

(A-l)2 

(0-*>l 

(T-13) 1 

(V-2) 3 

(Q-l)l 

(0-1)3 

18 

IS 

(T-2)  2 

(T-15)  1 

(V-4)l 

(0-2)1 

(TM-1) 1 

(T-8) 1 

(T-18)i 

(V-6)2 

(0-3)1 

(TM-2)  1 

(T-7) 1 

(P-2) 1 

(3-2)3 

(0-4)1 

(T-9)  1 

(P-3) 2 

(30-1)  1 

(0-8)1 

,(T-11)2 

(M-l)3 

(A-l)l 

(0-9)1 

(T-13)l 

(V-2) 1 

(Q-l)l 

(3-1)2 

10 

3 

(T-l) 1 

(P-2) 2 

(V-4) 1 

(0-2)1 

(0-1)2 

(T-2) 1 

(P-3) 2 

(V-6) 1 

(0-3)1 

(TM-1) 1 

(T-8)  1 

(M-l)2 

(3-2)2 

(0-4)1 

(TM-2) 2 

(T-ll)2 

(V-2) 1 

(30-1)1 

(0-8)1 

(0V-1)4 

(T-13)l 

(V-3) 1 

(A— 1)  1 

(0-»)l 

22 

« 

(T-2) 1 

(T-17) a 

(V-3) 3 

(A-l)2 

(0-9)1 

(T-8) 2 

(T-18) 1 

(V-4) 3 

<A-3)4 

(0-1)3 

(T-ll)4 

(P-2)2 

(V-6) a 

(1-1)1 

(rj-i)2 

(T-13)2 

(P-3) 1 

(3-2)2 

(0-2)1 

(TM-2) 2 

(T-14) 1 

(P-8) 1 

(3-3)1 

(0-3)1 

<0V-1)7 

(T-13)2 

(M-l) 1 

(3A-1) 1 

<0-4)1 

(0-8)1 

(T-l  ’j)  1 

(Y-2) 1 

(y-i)i 

12 

3 

(T-8)  1 

(T-13) 1 

(V-2) 1 

(0-2)1 

<0-1)2 

(T-8il 

(T-17) 1 

'V-4)3 

(0-3)1 

(TJi-i)  1 

(T-ll)2 

(P-3)  1 

(V-6) 1 

(0-4)1 

(TM-2)a 

(T-13) 1 

(P-8)  1 

(3-2)2 

(0-8)1 

(0V-1)4 

(T-14) 1 

(M-l) l 

(SA-1) 1 

<0-9)1 

76 


2XL-B-6104 

9 

4  <T-2) 1 

<T-8>1 
/T-U>3 
<7-18)2 

1IL-A-U 

23 

10  (7-1)1 

(7-8)1 
(7-5)1 
(7-8)1 
<7-10)1 
(7-X1) l 

2IL-B-93 

25 

18  (7-1)1 

(7-6)3 
(7-11)2 
(T~13)l 
(7-15)2 

MIL-8-10509 

27 

17  (T-8)l 

(T-10)l 
(7-11)2 
(7-15)1 
(7-17)1 

MIL4-94 

21 

14  (r-8)4 

(7-11)2 
(7-13)1 
(7-15)1 
(7-17)3 

MIL-8-28 

5 

5  <7-10)1 

MXL-B-11804 

8 

4  (wv-i)l 

MIL-8-19 

5 

4  (7-1)1 

MXI/-8-22 

4 

3  (7-11)1 

<7-13)1 

MIL-8-9444 

7 

5  <7-2)1 

(7-10)1 

MIL-8-1 

(diod*«) 

21 

18  (7-1)1 

(7-2) 1 
(7-4)1 
(7-7) 1 
(7-11)1 
<7-18)1 

MZL-I-1 

(tub««) 

38 

21  (T-l)ll 

(7-4) 1 
(7-7)2 
(7-11)1 
(7-13) 1 
(7-15)1 

2IV-T-1980Q 

(transit tors) 

19 

14  (7-1)2 

(7-2) 1 
(7-4)2 
(7-7)1 
(7-11)1 
(7-15)1 

7fl 


<7-17)2  <3-3)1  (Q-8>1  (72-2)2 

(2-1)1  (Q-2)  1  <Q-8)1  (0f-l)3 

(7~*>3  ■  <Q-3)1  (0-1)2 

<8-2)4  <{4-4)1  <TM-1)2 

(T-13)l  <V-3) 1  (Q-2) 1  (TK-1) 1 

<7-13)1  (V— 4)2  (Q-3) l  (ThC-2)  1 

<7-17)1  <3-2)1  (Q-4)l  (07-1)2 

<P-2)4  <30-1)1  (Q-8)l 

<P-3)1  (7-1)1  <0-»)l 

(7-2)1  (A-X)l  (0-1)1 

(7-17)1  (v-e)i  <Q-4)i  <m-3>a 

(P-3) 2  (8-?) 1  (Q-3) 1  (07-1)8 

(P-3)l  (7-1)1  (Q-9)l 

(7-3)1  (0-8)1  (0-1)2 

<7-4)1  (0-3)2  (70-1)2 

(M-2)3  (P-3)  1  (Q-4)l  (711-2)1 

(7-2)1  (7-1)1  (0-8)1  (0-1)2 

(7-4)1  (A-l)l  (0-9)1  (07-1)4 

(T-8)l  (0-2)1  (0-1)2 

(P-2) 3  (0-3)2  (72-1)1 

<P~2)3  (7-8)1  (Q-3)l  (72-1)1 

(P-3)l  (8-2)2  (Q-4)l  (72-2)1 

(7-2)1  (80-1)1  (Q-8)l  (D-l)2 

(7-3) 1  (7-1)1  (Q-»)l  (07-1)6 

(7-4)2  (0-2)1  (0-1)2 

(7-15)1  (P-S)l  (7—4)1  (07-1)2 


(7-11)1  (7-13)1  (P-2)l  (07-1)1 

(7-2)  (7-2)1  (A-l)l  (07-1)2 

(2-1)1 

(7-81)1  (2-1)1  (8-2)1  (Q-7)l 

*7-3) 1  (7-8)1  (0-3)1  <Q-8)1 

(7-17)2  (7-5)1  (0-1)2  (0-9)1 

(P-2) 1  (7-rSl  (Q-2)2  (0-1)1 

(P-3)l  (7-7)2  (0-3)2  (72-1)2 

(2-1)1  ,8-2)3  (0-4)1  (72-2)3 

(7-5)2  (8-3)1  (0-8)1  (07-1)7 

<7-4)1  <7-1)1  (0-8)2 

iT-18) 1  (7-5)1  (0-2)3  (0-9)1 

(7-17)1  (8-2)3  (0-3)4  (0-1)2 

(P-3) 2  (8-3)1  (0-4)1  (T2-l)4 

(7«2) 1  <*-5)2  0-«)l  (72-2)4 

(7-3)4  (A-a)l  (0-7)1  (07-1)2 

(7-4)3  <q-i)l  <0-8)1 


!  7-17)2  (7-5)1  (0-1)2  (0-9)2 

P-2) 1  (7-8)2  (0-2)2  (0-1)8 

P-31  (7-71 1  (0-3)2  (72-1)8 

2-1)1  (8-2)4  (0-4)1  (12-2)4 

7-3)3  (8-3)1  0-«)3  (OV-l)4 

7-4)1  (7-1)1  (0-4)2 


SUBTAflK  S 

1.  Summary 

Subgroup  ST-6  distributed  two  queationaires,  one  to  Industry  and  one  to  the 
Military  Services,  In  order  to  determine  actual  procurement  practices  relating  to 
electronic  parts.  Summaries  o f  the  survey  results  and  the  subgroup's  conclusions 
end  recommendations  are  presented. 


2.  d  Mission 

The  subgroup's  assignment  was  a  study  of  the  procurement  and  engineering 
practices  of  contractors,  supply  groups  and  other  agencies  to  ensure  the  use  of 
qu- lifted  and  reliable  parts. 


3.  Summary  of  Replle.i  from  htdactry 

(1)  Qualified  Products  List  parts  are  used  In  moderate  amounts  In  re¬ 
search  and  development  equipments  and  In  larger  amounts  In  production  equipment. 

(2)  Where  QPL  parts  are  used,  only  14  of  36  companies  call  out  such 
parts  by  their  military  specification  part  numbers. 

(3) ~  A  significant  number  of  parts  is  purchased  from  an  engineering- 
department-approved  source  of  supply.  However,  only  a  small  number  of  com¬ 
panies  (4  at  25}  base  the  listing  on  complete  qualification  tests.  An  additional  5 
companies  use  partial  qualification  tests,  and  10  use  evaluation  ttats  different  from 
QPL  testa. 

(4)  In  general,  company  specifications  are  not  prepared  by  equipment 
manufacturers  to  cover  QPL  parts,  and  although  engineering  departments  indicate 
medium  to  light  control  over  the  purchasing  department  with  respect  to  using  ap¬ 
proved  sources,  purchasing  departments  usually  have  buyers'  choice  among  the 
listed  sources. 

(6)  Of  33  companies,  30  Indicated  that  functional  organizations  other  ~ 
than  engineering  departments  could  cause  the  purchasing  department  to  use  other 
than  approved  sources,  but  this  happened  Infrequently. 

(6)  Very  few  parts  purchases  for  research  and  development  (R&D) 
equipments  include  the  requirements  that  the  supplier  conduct  acceptance  testa, 
lie  purchase  of  only  a  moderate  number  of  parts  for  production  equipments  re¬ 
quires  acceptance  tests  by  suppliers. 
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(7)  Very  little  acceptance  tasting  1 n  performed  In  contractors'  plants 
for  parts  used  In  A&D  equipment,  Thera  Is  a  moderate  amount  of  acceptance  testing 
In  '’ontrac tors'  plants  on  parts  uaed  lr.  production  equipment,  but  most  of  them  are 
not  complete  acceptance  teats.  After  the  first  production  order,  only  a  few  parts 
are  tested  to  determine  complete  conformance  to  specifications. 

(8)  Only  2  of  29  companies  report  to  the  Armed  Services  Electro- 
Standards  Agency  on  parts  not  conforming  to  military  specifications.  Eleven  of  the 
29  companies  Indicate  they  report  noncompliance  to  the  procuring  activity,  but  such 
reports  ara  made  in  only  limited  numbers. 


4.  Conclusions  Baaed  on  Replies  from  Industry 

A  review  of  the  Industry  survey  leads  to  the  following  observations  relative 
to  making  any  "reliable  parts  specification"  meaningful. 

(1)  The  existence  of  a  good  military  specification  will  not  be  meaning¬ 
ful  unless  administrative  control  over  the  use  of  standard  part3  is  effectively 
exercised  to  ensure  that  prime  contractors  use  standard  pints. 

(2)  Complete  acceptance  and  qualification  tests  are  essential  to  the 
reliable  parts  program.  No  formal  machinery  exists  to  ensure  that  these  tests  are 
made  for  parts  purchased  by  prime  contractors  or  to  ensure  feedback  of  test  infor¬ 
mation  to  a  central  military  group  for  the  purpose  ot  specification  and  QPL  main¬ 
tenance. 


(3)  Other  subgroups  have  made  recommendations  that  will  fulfill  the 
noeds  stated  in  paragraphs  (1)  and  (2)  above. 


8.  Summary  of  RtipUee  of  Military  Serricee 

(1)  The  age  of  parts  in  3tock  bins  in  the  field  is  consider ed  to  range 
from  one  to  8  years,  with  the  exception  of  specific  items  that  have  an  expected  short 
shelf  life  (a.  g, ,  batteries  and  electrolytic  capacitors).  The  high-use  items  are 
considered  to  average  2  to  8  years.  One  Military  Service  indicates  that  Inactive 
items  are  specially  packaged  and  periodically  examined. 

All  three  Military  Services  have  different  approaches  to  the  determination  of 
stock  levels.  One  stocks  to  meet  3  to  14  months  requisitioning,  plus  procurement 
lead  time  (up  to  9  months),  depending  on  the  item's  value.  Another  considers  a 
1-month  safety,  plus  9  months'  average  procurement,  plus  an  economically  deter¬ 
mined  level  which  varies. up  to  5  years  for  low-use  items;  note,  however,  in  the 
preceding  pr  > graph  that  average  age  for  parts  is  3  years.  The  third  stocks  for 
o m  and  Giws-Urtlf  months  to  20  months,  plus  a  "war  readiness"  level. 

(2)  AU  the  Military  Services  retorted  a  procedure  to  purge  obsolete 
parte .  One  indicator  control  through  automatic  data  processing.  The  second 
indicates  only  limited  control  currently,  but  it  is  building  up  EDP  (electronic  date- 
processing)  equipment  to  improve  the  situation.  The  third  indicates  a  rather  com¬ 
plete  control  through  the  issuance  of  (a)  bulletins  directing  the  disposal  of  specific 
obsolete  items,  (b)  "do  not  replace'1  instructions  and  (c)  listing  of  "stock  number 
actions"  (alternate  replacements). 


78 


(3)  Although  til  tho  Military  Services  indicate  a  control  of  aged  (not 
obsolete)  parts,  a  carnal  reading  of  the  answers  Indicates  that  this  Is  effective  only 
for  dated  Items  (such  as  battarloa,  etc.),  but  that,  once  other  parts  are  broken  out 
of  r«»/*vaoA3  and  pul  in***  Mrs,  their  ago  usually  cannot  be  determined.  (Cue  section 
5,  paragraph  (1),  for  Service  opinions  on  age.)  All  tubes,  Including  the  subtnlnia- 
ture  variety,  are  date-coded. 

(4)  Two  Military  Services  Indicate  that  80  percent  of  orders  for  parts 
and  tubes  are  for  purchases  totaling  less  than  $1, 000.  A  third  Service  Indicates 
46  percent  for  purchases  totaling  less  than  |1, 000.  One  states  that  only  about  34 
percent  of  the  dollar  value  of  purchases  fall  Into  JAN/MIL  Items.  (Converted  Into 
numbers  of  parts,  this  should  be  well  in  excess  of  60  percent. ) 

(5)  Two  Military  Services  indicate  that  qualified  parts  are  Inspected  In 
accordance  with  military  specifications.  The  third  reported  that  Inspection  of  quail" 
fled  partr  is  by  surveillance  to  ensure  that  contractors  are  maintaining  the  required 
standard  jf  quality  during  production.  One  specifically  stated  that,  where  a  QPL 
exists,  procurement  Is  only  from  a  qualified  source. 

(6)  Technical  review  of  purchase  orders  varies  among  the  Military 
Services.  One  has  a  technical  group  at  its  stock  control  activity  to  screen  orders 
for  replacement  parts  of  commercial  variety,  with  a  view  to  supplying  equivalent 
parts  to  a  military  specification  and  for  consolidate  .  'nto  larger  orders.  Note 
that,  even  with  this  consolidation,  80  percent  of  1  *  .  ders  are  for  less  than  $1, 000. 
This  group  also  passes  on  the  acceptability  of  sub.  stations  or  exception  in  bids. 

One  Military  Service  refers  technical  questions  to  "maintenance  engineering"  and 
the  third  Service  refers  technical  questions  through  a  liaison  engineer  to  its 
standardization  group. 

(7)  One  Military  Service  Indicated  positively  that  specifications  are 
never  changed  to  accept  the  lowest  bidder.  Answers  from  the  others  imply  the  same 
situation.  However,  answers  from  all  three  indicate  that  Information  from  bidders 
may  result  In  readvertlslng  for  alternate  Items,  presumably  based  on  equivalence 
as  determined  by  the  technical  review.  Note  that  one  Military  Service  (In  paragraph 
(6)  above)  states  that  only  qualified  parts  are  purchased  where  a  QPL  exists. 


6.  Conclusions  Baaed  on  the  Military  Services’  Replies 

A  review  of  the  Military  Services'  replies  leads  to  the  following  observations 
relative  to  the  effectiveness  of  any  "reliable  parts  specification." 

(1)  Any  decision  to  modify  a  specification  must  consider  stocking  levels 
In  the  Military  Services  and  must  be  based  on  the  knowbedge  that  such  modification 
will  affect  replacement  stock  levels  averaging  two  to  three  years  of  Service  demands. 

(2)  A  further  consideration  is  the  volume  of  paper  work  behind  stock 
control  (see  paragraph  (2),  section  6),  reflecting  not  only  the  cost  of  replacing 
parts  In  all  depots  but  also  the  cost  of  issuing  stock  control  bulletins  and  changes 
to  Instruction  books  resulting  from  any  specification  change. 

(3)  Consideration  should  be  given  to  adding  age  identification  In 
specifications  for  all  "reliable"  parts. 


(4)  The  purchase  and  use  of  reliable  parti  by  the  Military  Services 
moat  b«  effectively  controlled  to  prevent  the  substitution  (by  "consolidation"  or 
"equivalence")  of  a  part  with  lower  or  no  specified  life  expectancy. 

(5)  The  levels  of  stock  replenishment  have  been  established  as  raa tilt¬ 
ing  in  the  bulk  of  purchases  covering  orders  less  than  |1, 000.  This  points  strongly 
toward  the  following; 

(a)  Consolidated  purchases  of  Identical  items  for  the  three  Mili¬ 
tary  Services; 

(b)  Much  greater  consolidation  of  styles  and  sizes  of  permissible 
"standards"  to  eliminate  numerous  purchases  of  many  varieties  of  parts  In  small 
quantities; 


(c)  A  need  for  con  .^ious  Inspection  of  production  In  the  parts 
manufacturers'  plants. 

(8)  Other  subgroups  have  considered  the  conclusion  stated  In  para¬ 
graph  (5)(c)  above. 


7.  Recommendations 


The  following  actions  are  recommended  by  Subgroup  ST-5,  based  on  the  fore¬ 
going  considerations: 

(1)  Establish  effective  administrative  control  machinery  to  ensure  that 
prime  contractors  make  maximum  use  of  an  abbreviated  listing  of  standard  reliable 
parts  0>ee  recommendation  $)  below)  in  equipment  design. 

(2)  Restrict  the  styles  and  types  of  standard  reliable  parts  to  a  consid¬ 
erably  greater  degree  then  la  currently  done  for  military  standard  parts  in  order  to 
minimise  the  test  load  Inherent  in  establishing  failure  rates. 

(3)  Institute  a  study  of  the  details  of  stock  binning  down  through  all 
levels  of  the  supply  system,  from  stock  control  point  to  field  repair  activities,  di¬ 
rected  specifically  toward  ensuring  flrst-ln/flrst-out  stock  control  and  the  mainte¬ 
nance  of  information  on  Identity  and  age  of  parts. 

(4)  Modify  standardization  manuals  to  Include  procurement  policies  that 
are  of  concern  to  specification  wrltars  and  essential  to  tha  adequate  preparation  of 
■pacifications. 

(5)  Establish  consolidated  procurement  of  standard  reliable  parts  for 
replacement.  The  procurement  of  such  parts  by  a  single  Military  Service  la  a 
possible  solution. 
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EXHIBIT  A 

QUEETIONirAOUT  iJlSTHTBOTSD  TO  THE  MILITARY  SERVICES 
SbppIt  (Distribution) 

1.  What  la  your  impression  regarding  the  age  0 f  parts  In  your  supply  bins  in  the 
field? 

2.  Have  you  an  established  procedure  for  continually  purging  obsolete  stock? 

3.  Have  you  a  means  of  identifying  the  age  and  the  manufacturer  of  parts  in  the 
stock  bins  at  major  depots  and  at  repair  bases  (after  removal  from  shipping 
containers)? 

4-  Have  you  any  regular  orders  to  remove  aged  (not  obsolete)  stocks  in  the  field? 
What  are  they? 


jupplr  (Procurement) 

Note:  All  questions  concern  the  procurement  of  electronic  parts  only. 

1.  What  percent  of  your  parts  orders  are  for  less  than  $1000?  more  than  $1000? 

2.  Of  those  that  are  not  for  qualified  parts,  what  kind  of  information  do  you  use 
to  determine  what  to  buy? 

Engineers  specifications 

.Drawings 

Others 

3.  What  acceptance  testing  do  you  require  for 

a.  Qualified  parts? 

b.  Nonqualified  parts? 

4.  Do  you  maintain  a  technical  group  which  may  decide  on  equivalence  of  parts 
between  orders  for  purposes  of  more  advantageous  procurement? 

5.  Are  their  findings  in  any  way  reviewed  by  order  originator? 

Or  a  technical  arm  of  your  .Service? 

8.  Does  the  requirement  fok  the  low-bidder  purchase  result  in  any  operations 
that  may  tend  to  change  purchase  orders  specification  after  receipt  of  bid? 
Comment* 

7.  In  determining  the  level  of  stocks,  approximately  what  period  of  time  do  you 
stock  for? 


lyear?  2yeare?  Other? 
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EXHIBIT  B 


Compilation  M  Quart  lonffttra 

Inapactlon  Prtctlcot  tn  Contractors^ 

Enytnxrlnc  and  Procuramant  of  Elactrtcal  and  EUctronlc  Part* 


1*  Vm  tha  appropriate  block  bolov  te  Indicate  aaafo  of  qoallflad  (gn)  All  tar/ 
opacification  alaotrlaal  and  alaoirortla  parte  in  70 or  mil  tar/  aqulpaant. 


1*  9  HMBOnOi 

% 

*•  9*  jraor  prodaatlan  drawing  Mila  of  aatarlala  (or  material  a  Hat)  identify 
Milter/  opacification  alaotrlaal  and  olaotronio  parteT 

(a)  [  »  j  directly  by  Military  part  aaa *ar  or  typo  designation  collect. 

(b)  m  IMUrrotly  by  bm  of  n^ay  internal  aanfcaro. 

(a)  j  <1  althar  ar  bath  of  abana, 

3*  If  2b  or  2o  abort  la  chocked,  art  Military  opacification  parte  procured, 

(a)  I  I  I  by  purchaaa  ordar  callout  of  KiliUry  port  mnbor  or  t/p# 
d  trig  nation,  or 

(9)  JjJj  by  purohaaa  ordor  callout  of  oompany  Internal  ntasbor? 
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Many  All  Son*  hv  Hn?  AU 

*  *  D  MDDOCTIO* 

$.  Ar*  t£*  above  anfinaarinf  approved  aourcta  biMd  primarily  Ml 

(a)  CZ3  totiaaarin*  Jodfaant 

(*)  Partial  qualification  taat 

(c)  f  lO  I  Win^rinf  valuation  taat  (different  fro.  Qualification 
nit) 

(&)  m  Complete  Salification  taat 

6.  Do  you  prepare  ooeplata  apecifioationa  for  miltnry  (OR.)  part*  (alsotrlaal 

and  alaotronlo)  in  ordar  to  Halt  the  aouree(a)  #f  aupply  t rvm  - 1  w  tout 

porohaala*  d*  part-ant?  '  ^VKr  Wpa  Mad  by  ym«r 


1. 


Mi. 

„  .  .  nomcnot 

s-syisstiirys  ssrsisssa  -»*- «.  r»- 

_ _ ,  1  M  ,H  ef  **>ror',d  *o «*•(•)? 

(•)  QTJ  rut* 

w  Ho  y  n»4im 

(•)  >  2  |  Loom 

C«*  It  happen  oitdiattll;  or  dollborntoly  that  mw _ . 

**“  «*-<•>  ~*  *»*»*  * 
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10.  Cm  nry  twetion*l  a?*** isatien  yoar  pwchaain*  Ajpcrlwni 

t<»  profto-*  fro*  o *J\»e  thM  ih*  *n*in*«?Jr4  »ppr«T»d  #ouitj*fs)7 

(»)  |  "g  "|  Production  planning 

(b)  [JJ  «<«tr9l 

(«)  DJ  *r*5Ti';g 

(d)  rn 

{*)  HI  Oihtr 

S3  * 

j  U~1  Jfo  Kismr 

11.  Do*'*  r*c«S.rinCj  r#c«irin$  l»*t*etion  or  qutlity  co.rtrd  rupport  the  «ngl- 
noaring  ■pprcvad  tourc«(s)  byt 

(a)  f  18  |  Jtetwnint  nWpwurt  of  part* 

(b)  fjfl]  ieotpitott  Oxlpmnti  and  KoiXtjlaz  tnfia**rinf 

(e)  (  3  Chaatials*  purchasing 

W  pT]  Oth»r 

(«}  |  ?  (  if  eotibiMtloj),  cbaeb  h*n*  *ed  idwitify  aaefc 

CD  3fe  SftlWl’ 

12.  Co*  a  roar  [~rT~j  •**&*«*»$,  f*u‘]  ywrabaatiisg,  {17  1  T»*Uty  control, 
/s~7  Ho  *nr«tr,  s*o«F*t*ly  or  is  confetaatiori  d<**nrf  by  specification 
purcbcM  ordw  rcqalnatmt  t*wt  aupplidfs  co ndact  acceptance  teat* 

os  (<3PL)  P«rt«? 


222 

nowtM 
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*r 

Ti 

£ 


n 


13.  .1>*«  [  13~|  an*ln*orln*,  1  H  1  ptewhaai**,  f  17  j  r*m?  oofitrol, 

^L7  ,isb^naw'  aaparataljr  or  In  conblnatlon  roqulra  •ridanca  of  Mo.  12, 

(a)  f  12  1  CirUfiad  ateteaant 

(b)  f  lfl  )  Cartiflad  taai  date 


(o)  Q  1  Ibat  date  (not  oortlflad) 


rimu. 
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l«UM  U  •  M  •  f 


17.  flow  mrrf  tlwai*  harw  jrcra  rapartad  nem  ao rpUanoa  wlU  apsoifiaati out  baaad  cm 
UtlC  oondrwtad  par  It#>*  Bo,  is,  aborwT 

to  tiurvnr  -  1  Coupon/* 

U*»*t  know  -  /  Coapaalaa 
ton*  -  1  Coopargr 

Tory  7*v  »  1  Co*p*rgr 

T»v  -  1  Co span/ 

Stnril  -  1  Gomptrgr 
Many  -  3  Conpani** 

Pujwrau*  -  1  Coapany 
tan  -1  Company 

13  Anavars  drcopad  tMUN  of  inoonatataneiaa  vita  an mar*  to 
qoaatlona  lb  aid  15* 

10*  Paragraph  13,  *di  attribution  of  toot  data,"  of  •proYialcma  governing  <r**lifl- 
"(D* porta* at  of  Daftoao,  Anted  Sorvlooa  itoppl y  flapper!  Cantor.  17  Moo 
1958)  atataa  la  part  "to at  reporta  or.  information  therefrom  will  not  ba 
furnished  to  coooamlal  aotivitlab  witheat  perclsalon  fro*  the  Murafaoturar.* 

(a)  Would  tho  qualification  toot  raport  aarrv  &  aeafvl  parpoaa  to  yon? 

QlL™  CD * 

(b)  Could  70m  assure  parts  supplier*  that  yon  would  hold  taat  data  In 
oonfldano*  and  not  dlaoloa*  to  hi  a  co«patitor{i)7 

ra  »•  m- 

(0)  Do  you  obtain  suoh  raporta  now  dlneotly  fro*  porta  wppllars? 
m  Taa  fin  to 
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APPENDIX  I 


OrPICS  Of  THE  ASSISTANT  SECRTTAHY  Of  DEFENSE 
'VASHINOTO*  ii.  a  c. 


laUKCH  AND  0MIMXX1N* 

14  July  1958 


>CEHORAKHjM  '8  ACRE2XEOT 

SUBJECT:  Jointly  Spcne.  ed  OSD  (FAE/S&L)  Ad  Hoc  Study  on  Electronic  Part* 


The  rapidly  changing  state  of  the  electronics  art  vith  increasingly  mora 
c cap lex  equipments  demanding  high  reliability  has  created  the  need  for  (a)  ad¬ 
ditional  requirement a  in  electronic  parts  and  tubes  specifications,  (b)  more 
rapid  coordination  of  specifications,  (c)  establishment  of  technical  char¬ 
acteristics  data  for  dissemination  to  design  and  logistics  personnel  end  (d)  a 
complete  reviev  of  the  parts  specifications  program  to  Insure  compatibility 
vith  the  reliability  program. 

In  Tien-  of  the  above,  it  is  felt  that  the  solution  to  these  problems  should 
be  undertaken  in  the  manner  delineated  in  Enclosure  (l). 


QAHD  (SAL)  QA8D  (B&E) 


SrtoiosvTe  -  1 

.Task  Assignment  for  Ad  Hoc  Study  on 
hurts  Specifications  Management  for 
Reliability 
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Enclosure  1 


> 


i 


I 


Tt'jt  tmiamxs:  rcr. 

AD  HOC  9TODT  Oil  PAHTS  SF2CI72CAXI0?T8 
KAXADBOOT  TOR  RKLEABIimr 

“.“LiiTcSts.c.trsiL?rt‘  r1  m’"  “  •*»*«•*  -r  «* 

(Supply  and  Inglitice),  ?  D*f*n*®  (R*»«*rch  (M  Engineering)  and 

«®  *IU  <•  »/ 

either  full  tla*  mr. _  *  'ruJ’  selected  by  the  sponsor*  and  win  be 

retary  o^e^.  «P^>«  or  cumulate  to  the  Office  of  the  Sec- 

3.  The  «tudy  ehall  be  conducted  by  the  following  people: 

(a)  Cbairaan 

(b)  One  Mober  fra*  QA3D  (RiS) 

(C)  Qae  aenber  fro*  OASD  (SiL) 

(d)  Two  aeaber*  fro*  each  of  the  Kilitary  Departments 

<*)  °“  *Cmb*r  ««  *  **rrice.  Rlectro-Standarde  Agency) 

(f)  Bix  sea hern  selected  fro*  Consultant*  to  the  am  . 

experienced  In  tha  era*  of  electron*,.  06D  —  two  shall  be 

the  area  of  electron  tu&5  ox?*rienced  111 

equipment  and  ayateu  design.  «T«rleaced  In  electronic 

«  «“  waa-  ttu  M,  1.  4.U, 

«— u«  Man. 

“““*“*“*  «  niuimtr 

•e-s^sy 2?  -i— 
srjf.’srrrr  s~H“ 

s^sa-sas  mssl-.ss&S?  -• 

talopS  SafSuSog  —  -• 
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5.  The  basic  objective  of  this  study  1*  to  analyte  t be  recccmendatlons 
established  by  tha  KCFXZ  Task  Group  5  In  order  to  advise  tha  Assistant  Secretar¬ 
ial  of  Do  fame  (PAh)  and  (CAL)  regarding  officiant  implementation  methods  and 
procedures.  The  study  shall  include  j 

'  (a;  Recce* sanded  criteria  and  methods  for  specifying  tha  reliability  of 
parts  and.  tubas  In  tanas  of  failure  rata  as  a  function  of  time,  environment  and 
circuit  application  saver Ity. 

(b)  Survey  tie  methods  used  In  preparation  of  parts  and  tubes  speci¬ 
fications  as  veil  as  coordination  procedures  and  practices.  This  survey  shall 
b«  oade  to  suggest  changes  vhich  vould  accomodate  tha  specification  of  reli¬ 
ability  level  and  Its  allied,  reliability  assurance  requirements.  Procedures  pro¬ 
posed  abail  be  to  enhance  rapid  and  full  specification  coordination  within  the 
Military  Departments  and  with  Industry. 

(c)  Periev  of  Qualified  Products  List  (QPL)  and  Qualifications  Testing 
Procedures  to  evaluate: 

(1)  If  qualification  is  beLig  properly  implemented. 

(2)  Adequacy  of  tests  with  respect  to  the  reliability  require¬ 
ments  and  quality  control  procedures  included  In  the  specification. 

(3)  Provisions  for  avoiding  any  duplication  of  Qualification 
Testing  by  various  contractors. 

(d)  Recommend  reliability  assurance  test  procedures  to  verify  com¬ 
pliance  with  the  reliability  level  specified. 

(a)  Recommend  a  program  and  methodology  for  obtaining  technical 
characteristics  and  test  data  of  parts  Including  failure  rate  data  and  the  pro¬ 
cedure  for  making  this  data  available  to  designers  and  logistics  personnel. 

(f )  Investigate  the  need  for  a  document  other  than  the  specification 
to  provide  design  guide  Information  such  as  parts  and  tube  application  curves 
(including  failure  rata  curves  or  data  as  a  function  of  circuit,  application 
severity  level  and  environment).  Such  a  document  would  provide  design  guide  in¬ 
formation  a a  oppos'd  to  the  firm  specification  requirement  data  mentioned  above. 

6.  A  report  of  the  conclusions  reached  as  a  result  of  this  study  will  be 
prepared  for  consideration  by  the  Assistant  Secretaries  of  Defense  (BAR)  and 
(SAL).  It  la  expected  that  the  study  will  be  comp— sted  within  tlx  months. 
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APPENDIX  HI 

VROlrCSKD  DEPARTMENT  OF  DEFENSE  INSTRUCTION 

SUBJECT:  Advisory  Group  on  Management  of  Electronic  Parts  Specifications 

References:  (a)  DOD  Directive  No.  5120.1  "Assistant  Secretary  of  Defense 
{Supply  and  Logistics), "  January  7,  1969. 


I.  PURPOSE 

To  aid  the  Assistant  Secretary  of  Defense  (Supply  and  Logistics)  in  carrying 
out  the  functions  set  forth  in  reference  (a),  the  Advisory  Group  on  Management  of 
Electronic  Parts  Specifications  is  hereby  established  as  an  activity  of  the  Office  of 
the  Assistant  Secretary  of  Defense  (Supply  and  Logistics)  (OASD-S&L),  Office  of  the 
Secretary  of  Defense  (OSD),  with  membership,  field  of  Interest  and  method  of  opera¬ 
tion  as  defined  heroin. 

H  DEFINITIONS 


A.  The  terms  "electronic  component  parts"  or  "parts"  mean  all  electronic 
parts,  including  electron  tubes  and  semiconductor  devices,  integrated  circuit  com¬ 
ponents  and  functional  components. 

B.  The  term  "parts  specification  program"  refers  to  all  electronic  parts 
specifications,  standards,  handbooks  and  other  required  technical  documentation. 

m.  MEMBERSHIP 


The  members  selected  for  the  Advisory  Group  shall  represent  a  balanced  team 
with  management  and  technical  experience  in  the  areas  of  electronic  parts,  tubes 
and  semiconductors;  the  electronic-systems  design  area;  end  the  electronics  engi¬ 
neering,  procurement  and  logistics  areas  of  the  Department  of  Defense.  The  Group 
shall  comprise  the  following  members: 

A.  The  Assistant  Secretary  of  Defense  (S&L),  after  collaborating  with  the 
Director  of  Defense  Research  and  Engineering  in  the  selection  of  members,  shall 
appoint  the  members  to  the  Advisory  Group  from  OSD  consultants  who  are  expert 
In  the  fields  Indicated  herein. 

B.  One  member  and  one  deputy  may  be  designated  by  each  of  the  three  Mili¬ 
tary  Departments. 

C.  One  member  and  one  deputy  may  be  designated  by  both  the  OASD  (S&L)  and 
the  ODDR&E. 

D.  to  addition,  agencies  of  the  Department  of  Defense  and  othor  agencies  of 
the  gsvemment  may  formally  nominate  representatives  to  serve  as  associate  mem- 
bare,  subject  to  the  approval  of  the  Assistant  Secretary  of  Defense  (SAL). 
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E.  The  Assistant  Secretary  of  Defense  (S&L),  aftor  coordinating  with  tha 
Dlractor  of  Defense  Research  and  Engineering,  shall  appoint  a  chairman  of  the 
Advisory  Group  from  among  the  members,  preferehlv  from  among  the  OSD  consult¬ 
ant  members. 

IV.  FIELD  OF  INTEREST 


The  field  of  Interest  of  the  Advisory  Group  on  Management  of  Electronic  Parts 
Specifications  shall  encompass  all  phases  of  DOD  programs  on  the  development  of 
electronic-parts  specifications  and  technical  documentation  and  the  management 
thereof.  It  shall  Include  the  preparation  and  coordination  of  specifications;  the 
designation  of  standard  preferred  parts  and  the  establishment  of  parts  lists;  the 
establishment  of  approved  sources  of  supply  for  qualified  electronic  parts  lists;  the 
establishment  of  test  methods  and  procedures  (sampling  plans)  for  reliability  and 
quality  assurance;  and  tha  development  of  engineering  application  data  for  electronic 
component  parts. 

V.  FUNCTIONS 


A.  General.  The  function  of  the  Advisory  Group  is  to  provide,  on  a  continuing 
basis,  technical  advice  that  will  aid  the  Assistant  Secretary  of  Defense  (S&L)  In 
planning  and  directing  an  adequate,  economical  and  effective  program  of  specification 
development  and  technical  documentation  in  the  area  of  electronic  component  parts. 

In  addition,  the  Advisory  Group  may  provide  similar  advice  to  the  Director  of  De¬ 
fense  Research  and  Engineering  and  the  Military  Departments  relative  to  their 
interests  in  these  areas. 

B.  Specific.  In  pursuit  of  its  stated  general  function,  the  Advisory  Group 

shall: 

1.  Review  all  proposed  DOD  programs  relating  to  the  development  of 
electronic -parts  specifications  and  technical  documentation  and  the  management 
thereof,  and  recommend  to  the  Assistant  Secretary  of  Defense  (S&L)  the  most  effec¬ 
tive  program  and  changes  to  proposed  programs  that  will  ensure  the  timely  imple¬ 
mentation  of  the  programs. 

2.  Prepare  and  recommend  DOD  policy,  program  and  implementation 
plana  for  the  development  of  specifications,  standards  arid  handbooks  for  electronic 
parts  regarding: 

a.  Priorities  and  schedules  for  the  specification-development  program 
that  will  be  consistent  with  the  operational  needs  of  tha  Military  Departments. 

b.  All  specification  programs  and  actions  to  ensure  their  adherence 
w»  jjts.bli3h.ad  schedules. 

c.  Techniques  and  guidelines,  to  be  used  in  preparing  military  speci¬ 
fications,  that  will  ensure  the  completeness  and  adequacy  of  specifications  for  pro¬ 
curement  This  shall  include  the  specification  of  performance  and  reliability  in 
standard  levels;  tost  plana  necessary  to  prove  compliance  with  specification  re¬ 
quirements;  procedures  for  qualification  approval;  and  the  development  and  dissemi¬ 
nation  of  parts  applies  ti  .  data,  including  failure  rate  as  a  function  of  time  and  levels 
of  application  severity. 
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d.  The  collection,  analysis  mid  us*  of  parts  characteristics  data  In 
the  development  of  new  specifications  or  the  revision  of  existing  ones. 

Z.  *wvte(rihe  programs  on  specifications  development  and  technical 
documentation  In  relation  to  the  many  other  programs  of  tho  Military  Departments, 
such  as  the  Long  Range  Parts  and  Tubes  Research  and  Development  Program  and 
the  Industrial  Mobilization  Planning  Program,  to  ensure  that  the  programs  are 
properly  coordinated.  This  coordination  shall  bo  extended  to  ensure  the  programs' 
compatibility  with  Industrial  facilities  and  activities  In  the  areas  of  electronic  parts. 

4.  Assist  in  resolving  areas  of  conflict  In  the  over-all  program  and  de¬ 
tailed  problems  arising  in  the  preparation  and  coordination  of  parts  specifications. 

6.  Develop  and  recommend  criteria  for  the  generation  of  preferred  parts 
lists  to  be  contained  in  military  standards  and  approved  sources  of  supply  for 
qualified  electronic  parts  lists  to  be  included  in  military  specifications  or  procure¬ 
ment  documents,  where  applicable,  to  ensure  that: 

a.  Preferred  parts  lists  are  developed  or  brought  up  to  date  and 
promptly  Issued. 

b.  Efficient  methods  and  techniques  are  employed  by  the  Military  De¬ 
partments  to  ensure  maximum  use  of  parts  on  the  preferred  parts  lists.  Where 
necessary,  the  Advisory  Group  shall  recommend  actions  to  improve  the  methods 
and  techniques. 

c.  Application  data,  including  failure  rates,  are  developed  and  pro¬ 
mulgated. 

d.  A  Parts  Qualification  Activity  for  each  specification  category  is 

established. 

e.  Qualified  products  lists  are  developed  and  promptly  issued. 

8.  Review  budget  requirements  for  the  programs  relating  to  specification 
development,  technical  documentation  and  standardization  and  recommend  adequate 
funding  levels.  Review  the  manpower  and  facilities  in  relation  to  the  required  fund¬ 
ing  levels  and  recommend  action  to  ensure  efficient  management  and  Implementation 
of  the  over-all  program. 

VI.  OPERATIONS 


In  performing  its  functions,  the  Advisory  Group  shall  operate  under  the  super¬ 
vision,  administration  and  control  of  the  Director  of  Supply  Management,  OASD  (3<S»L). 

Associate  members  of  the  Advisory  Group  are  invited  to  participate  in  pres¬ 
entations  and  discussions.  Any  dissenting  views  of  associate  members  may  be  pre¬ 
sented,  but  the  action  of  the  Advisory  Group  shall  be  determined  by  the  designated 
members. 
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The  Advisory  Group  Is  authorized  to  establish  such  working  groups  or  ad  hoc 
Z?"-p5  ss-tBa^-W  required,  a  abject  to  the  approval  of  the  Director  of  Supply 
Management,  OASD  (S&L),  coordinating  with  the  Director  of  Electronics,  ODDR&S. 

vn.  LIAISON 

The  Advisory  Group  shall  maintain  liaison  with  other  groups  and  agencies, 
both  within  and  outside  the  Department  of  Defense,  that  b*ve  related  Interests,  such 
as  the  Advisory  Group  on  Electronic  Parts  and  the  Advisory  Group  on  Electron 
Tubes,  ODDR&E.  The  Director  of  Supply  Management,  OASD  (SttL),  and  the 
Director  of  Electronics,  ODDR&E,  shall  collaborate  In  arranging  effective  liaison 
among  the  groups. 
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